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Helper Entity For C mmunication Sessi n. 
Field of the Invention 

5 The present invention relates to a helper entity for selectively offering assistance to a party 
joined to a communication session. In particular, but not exclusively, the present 
invention relates to a helper entity that can be joined to a communication session 
associated with a specific web page and which, when triggered, offers advice specific to 
that page. As used herein, the term "web" or 'World Wide- Web' means a network of 
10 systems running applications using the HTTP protocol (any version) and similar and 
successor protocols. 

Background of the Invention 

The hitemet and the World Wide Web (WWW) have made it possible for enterprises to 
1 5 sell products and services by using the WWW to describe offers, using various means such 
as WWW forms or electronic mail to conduct transactions. This form of selling is based 
around the catalogue model that originated in the 19* Century, where the WWW site 
substitutes for the paper catalogue, and the postal service is replaced by the modem online 
equivalent. 

20 

Many enterprises currently use the telephone to replace or augment the catalogue model. A 
customer can call the organisation and purchase goods and services interactively over the 
telephone. This has the advantage that a customer can interact directly with a Customer 
Service Representative ("CSR"), but has the disadvantage that the telephone is a non-visual 
25 medium. 



The need to handle large numbers of customers simultaneously, and the concurrent need to 
manage a pool of CSRs, has led to the development of the call centre, and the development 
of specialised software control packages to determine how incoming customer calls are 
30 routed to CSRs. 
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It is possible to combine the catalogue model of WWW selling with the telephone call 
centre (and other commxmication channels) to produce what is often called contact centre. 
The contact centre is like a telephone call centre, but instead of CSRs handling only 
telephone calls, they may be expected to handle customer communications in a variety of 
formats: FAX, electronic mail, telephone and WWW are typical. A contact centre is 
characterised by multiple contact or communication channels, and a pool of CSRs who 
interact with customers to provide services, products or support. The contact centre 
provides the illusion of a single point of contact for customers on a regional, national or 
even international basis. US patent 5,848,143 (Geotel Conmiunications) discloses a 
contact center capable of handling both traditional telephone calls and Internet calls where, 
in the case of the latter, the customer contact can involve multimedia exchanges. 

Contact centers, whilst providing many useful services, are not necessarily the best way of 
providing advice and assistant in all circumstances. In many cases, relatively simple advice 
1 5 is needed (for example, concerning something seen on a web page) and a party wanting the 
advice may be reluctant to waste time connecting with a contact center. 

Users of the public telephone system are familiar with automata in the form of the 
Interactive Voice Response (IVR) system. These are used in applications such as 

20 voicemail, call centres, and cinema listings, and consist of a recorded or synthetic human 
voice that offers a menu of choices, and the customer interacts by using telephone keypad 
tones. More sophisticated automata are finding their way into telephone directory 
enquiries, into business premises as telephone receptionists, and as "virtual personal 
assistants" for business telephone users. However, identifying what tasks can be usefully 

25 given to automata is itself a challenge. 

It is an object of the present invention to provide a way of offering assistance to people 
browsing a web site that does not involve the overhead of a contact center but which is 
responsive and flexible. 




Summary of the Invention 

According to the present invention, there is provided a helper entity for selectively offering 
assistance to an endpoint entity (generally a party acting through an endpoint system) 
connected to at least one media channel established in respect of a network communication 
session to which the endpoint entity is joined, the helper entity comprising: 

an entity manager for receiving, in respect of a particular conununi cation session, 
channel information about the channels established for the session; 
a transport subsystem for establishing, in accordance with the channel information 
received by the entity manager, at least one media channel connection to a session 
transport mechanism associated with said session; 

a media subsystem providing a respective media handler of appropriate type for the 
each media channel coimection established by the transport subsystem, each media 
handler serving to receive and transmit content over the corresponding media 
channel; 

a monitor subsystem connected to the media handlers for matching content received 
by the media handlers with predetermined triggers; and 

an advisor subsystem responsive to responsive to the monitor subsystem finding a 
match to transmit advisory content on at least one channel via the corresponding 
media handler. 

The helper entity is, for example, joined to a communication session associated with a 
particular web page and, when triggered, delivers advisory content relevant to that page. 



Brief Description of the Drawings 

A web interaction system embodying the invention will now be described, by way of non- 
limiting example, with reference to the accompanying diagrammatic drawings, in which: 
. Figure 1 is a diagram of a conununicatipn session abstraction of the web interaction 
system; 

. Figure 2 is a diagram of a session transport of the web interaction system; 
. Figure 3 is a diagram showing the functional layers of the system; 



. Figure 4 
• Figure 5 
. Figure 6 

5 • Figure 7 
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Figure 9 
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.Figure 11 
. Figure 12 
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. Figure 13 
. Figure 14 

. Figure 15 

.Figure 16 

. Figure 17 
. Figure 18 
. Figure 19 

. Figure 20 



is a diagram of a "Shop with Friends" session scenario; 
is a diagram of a "Page is Place" session scenario; 

is a diagram showing in detail the sequence of operations involved in 

routing a customer to a session and participants to the session; 

is a diagram of one possible physical configuration of the web interaction 

system in the situation where a contact center is connected up to the 

system; 

is a diagram illustrating the interactions between the components of the 
Figure 7 system upon a customer seeking to contact a call-center customer 
service CSR; 

illustrates a customer service CSR (CSR) graphical user interface (GUI) 
desktop, the desktop having both a call-management GUI component for 
managing multiple calls, and customer-interaction GUI component for 
interacting with a specific customer; 

shows a text-chat GUI sub-component of the Figure 9 customer-interaction 
desktop component when no call is selected; 

shows the text-chat GUI sub-component during use for a selected call; 
shows a page-push GUI sub-component of the Figure 9 customer- 
interaction desktop component; 

is a diagram illustrating the functionality of the CSR desktop; 

shows the Figure 9 call management desktop component showing a new 

call; 

shows the call-management desktop component upon a second call being 
answered by the CSR; 

shows the text-chat GUI sub-component when no media channel of this 
type is present for the selected call; 

shows the call-management desktop component upon a call being dropped; 
is a diagram of a customer GUI desktop based on applet technology; 
is a diagram of a cixstomer GUI desktop based on the use of a desktop 
proxy provided by the web collaboration service; 

is a diagram illxistrating the sequence of events carried out in executing a 



10 



Deferred Rendezvous service using the web interaction service system of 
Figure 7; 

. Figure 21 is a diagram illustrating the sequence of events carried out in extending a 
telephone session with a web rendezvous using the web interaction service 
system of Figure 7; 

is a diagram illustrating the sequence of events carried out in executing a 
'Shop with Friends* service using the web interaction service system of 
Figure 7; 

is a diagram illustrating the sequence of events carried out in inviting a 
CSR into a 'Shop with Friends' session using the web interaction service 
system of Figure 7; 

is a diagram illustrating the sequence of events carried out to alert a CSR to 
the presence of a valued customer in a 'Page as Place' service implemented 
using the web interaction service system of Figure 7; 
is a diagram illustrating a session browser available to a CSR using the web 
interaction service system of Figure 7, and the sequence of events carried 
out when the CSR decides to join a particular session; 
is a diagram of the functional components of a marketing BOT; and 
is a diagram of the functional components of a helper entity BOT. 



Figure 22 



. Figure 23 



Figure 24 
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. Figure 26 
. Figure 27 
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Best Mode of Carrying Out the Invention 

General Structure of Communications Mechanism 

25 Figures 1 to3 illustrate the basic functional concepts and elements of the web interaction 
system by which multiple parties can commimicate with each other across the web (World 
Wide Web) using mxiltiple media types. 

As will be more fully described below, the basic high-level abstraction used by the system 
30 is that of a communication session 1 1 (Figure 1) to which one or more entities 12 A,B,C 
(participants) can be added or removed, as directed by a web interaction service 26 (Figure 
3) to provide a required communication service behaviour. The communication session 
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itself is generic and service-independent. The communication session abstraction 1 1 is 
modelled in the web interaction system by appropriate data structures and methods (for 
example, implemented as instances of a communication session object) for keeping track 
of a current session and its participants, and for effecting operations such as the adding and 
removal of participants. The functionality for creating, managing and implementing session 
instances is provided by a commxmications session manager 14 (shown in dashed lines in 
Figures). 

Associated with each conmiimi cation session 1 1 is a session transport 15 (Figure 2) which 
is an abstraction of functionality for actually effecting data communication between 
endpoint systems 16A,B,C corresponding to the session participants 12A,B,C, this 
commxmication being through one or media channels 1 7a, 1 7b, etc. The session-transport 
functionality is typically embodied as a central session-transport manager 19 (Figure 3) and 
communication components associated with the end-points, the manager being responsible 
for creating and managing a respective session-transport object instance for each session 
transport where state data is held for that session transport. 

Thus, the communication session manager 1 4 is concerned with the high level management 
and control of sessions whereas the session-transport functionality is concemed with the 
establishment and maintenance of the required media channels for the session transport 
that underlies each communication session. 

The on-going operation of the session-transport functionality is largely independent of the 
corresponding communication session manager 14 except for when session creation / 
destruction results in the creation / destruction of an xmderlying session transport, and for 
when the addition / removal of session participants results in the addition / removal of 
channels to/from the corresponding endpoint systems. The session manager 14 and the 
session-transport functionality are kept in step through "leg controllers" 20 (shown in 
Figure 3) which provide a way for a session 1 1 to pass to endpoint systems the information 
required to join a session transport, and to receive back related status information. 



The communication session 11, session transport 15, media channels 17, and leg 
controllers 20 are considered in more detail below with particular reference to Figure 3, 
This Figure presents a layered view of how the various elements of the web interaction 
system inter-relate to each other, the specific scenario shown being that of two session 
entities connected to the same communication session. As is typical for a layered model, 
the fimctionality of the higher layers is implemented using that of lower layers. 

Communication Session - A communication session 1 1 is a representation of the state of 
a set of communicating entities. An entity (participant) 12 will in most cases be a person, 
although software automata or Bots can also be participating entities. By communicating is 
meant that entities are using one or media types to communicate, such as speech (audio), 
video, plain text, diagrams and illustrations, graphics, animations and 3D content, the kind 
of communications that are appropriate between human beings who want to share 
information. By state is meant the collective attributes of a specific session: the identities 
of the communicating entities, the media types in use, the pattern of distribution of 
information, global session properties (such as admission criteria), privileged members of 
the set, etc. 

Associated with each instance of a communication session is a service instance that imparts 
service specific behaviour to the session by how it exercises the basic operations associated 
with the session (these operations are outlined below). It is the service instance that 
initiates creation of a corresponding communication session instance by making a request 
to a communication-session factory 13 functionally embodied in the communication 
session manager 14. Destruction of the commimication session instance is also controlled 
by the associated service instance and uses a "Destroy" operation of the session instance. 
The combination of the commimication session instance (and its associated leg controllers 
described below) and the corresponding service instance, form a service-session fimctional 
entity that manages group commimication for a particular instance of a particular service. 

Each communication session instance has associated functionality for carrying out the 
following operations in respect of the session it represents: 
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1 . Maintain the set of session entities currently in the session, together with individual 
connection states to the session (as reported through the session leg controllers - 
see below) and the various items of data that may have been collected about the 
entities. 

2. Create a session transport instance using session-transport factory functionality 1 8. 
The session transport is preferably created in a lazy fashion, only when required. 
The identity (ED) of the session transport instance and address forms part of the 
state of the communication session. 

3. In response to requests from the associated service instance, cany out a small 
number of session operations in respect of session entities, the results of the 
operations being reported in session events. Generally, the operations involve 
communication with the session entity (participant) concemed to cause changes in 
the connection state of the entity, these changes then being reported back to the 
session by the leg controllers and resulting in the generation of an appropriate event 
to inform the associated service instance of the result of the operation. The basic 
session operations and their corresponding events are: 

Add identified participant to the session - this results in an invitation being passed 
to the identified participant system followed by the generation of an "Added" 
event; if the invitation is accepted (as notified to the session through the 
corresponding leg controller) a "Connected" event is produced whereas if the 
invitation is declined (again, reported through the leg controller) a "Declined"; 
Remove identified participant from the session - the identified participant is 
removed fi-om the session (and session transport) and a "Removed" event generated 
(if the participant was the last remaining participant, then an "All Removed" event 
is generated instead); 

Transfer between two identified participants - the second identified participant is 
invited into the session and if this participant accepts to join, then the first 
participant is removed firom the session. Successful transfer results in a 
'Transferred" event being generated. 
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If appropriately authorised in the context of a particular service, session entities 
(participants) can also perform simple autonomous operations that affect the 
conmiunication session. Thus, a session entity can autonomously Join a communication 
session, if the connection details of the communication and session transports are known 
5 and the session entity has the appropriate privileges. Session entities can autonomously 
Leave the session. Both autonomous operations are arranged to cause the state of the 
communication session, including the set of session entities, to be updated with appropriate 
communication session events. 

10 The service instance associated with a conmiunication session instance has access to the 
data held by the session instance, including the participant data and session transport data. 

The Session Transport - As already indicated, each communication session requires an 
underlying session transport instance to communicate data (both real-time, and non-real- 

1 5 time) between session entities. The session transport provides for the transport of various 
media types in the form of un-interpreted messages of digital information. Any media type 
that can be reduced to a stream of bytes can be transported in the form of variable length 
messages. A session transport can be implemented, for example, by an IP multicast group, 
a unicast IP conference, or, as in the specific embodiment to be described hereinafter, a 

20 tightly-coupled, group commimication server. 

The session-transport functionality (in particular, session-transport manager 19) maintains 
state data on the state of each session transport. The state of a session transport is the 
collective attributes of a session transport, namely the connection, authentication and 
25 authorization parameters required to join in the data transport mechanism, the set of 
channels in the session transport, and the set of channel endpoints connected to the 
channels. 

Session-transport factory functionality 18 of the session-transport manager 19 is 
3 0 responsible for creating instances of a session-transport object used to represent and permit 
the set up of each session transport (in particular, a session-transport object will hold the 
state data for the session transport it represents). Requests from a commimication session 
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object to the session transport factory functionality to create a session transport are 
parameterised with the characteristics of the required session transport. The session 
transport factory 1 8 uses this information to create an instance of the session transport 
object that satisfies those characteristics. 

Media Channels - A session transport encompasses one or more media channels 1 7 where 
a channel is an instance of a multi-party communications path between channel endpoints 
22. Typically, a channel is used to disseminate information of a given media type. 
Examples of media types are textual chat, voice chat, shared whiteboard, collaborative 
brpwsing, and real-time voice and video. A channel can be used for sending control 
information, e.g. media-channel signalling information, queue status information, or 
positional updates in a 3D virtual environment. A channel can be used to deliver any 
digital information that can be reduced to a sequence of bytes, and will deliver this 
information as a sequence of messages to multiple channel endpoints. 

An instance of a channel is created within the context of a single session transport, A 
channel has a imique name within the session transport. A channel defines a 
communication path between the connected channel endpoints, that is orthogonal to all 
other channels associated with the session transport 

A channel endpoint 22 is an instance of an addressable communication source or 
destination. A charmel endpoint has a xinique name within the context of a channel. An 
instance of a channel endpoint is bound to a single, named channel. 

A media client 24 (Figure 3) is an instance of a specialized fimction to send and receive 
data of a specific media type, using a channel endpoint 22 bound to the channel for the 
media type. The media client 24 provides a specialized programmatic interface to the 
channel for communicating with other media clients of the same type. An application 25 
wishing to communicate using a particular media type, does so by creating a corresponding 
media client 24 which then creates a channel endpoint that contacts the session-transport 
manager 19 to establish a named channel appropriate for the specific media type, if one 
does not already exist. The media client 24 then tries to join the channel by creating a 
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channel endpoint 22 and binding it to the channel. The application 25 can then use the 
media client to send data to and receive data from other applications that are associated, via 
their respective media clients, with the other channel endpoints connected to the channel. 

5 There are three modes for sending data on a channel 1 7 from a channel endpoint 22: 

1 . Data is sent to all channel endpoints connected to the channel, including the sender. 

2. Data is sent to all channel endpoints connected to the channel, excluding the sender. 

3. Data is sent to a specific channel endpoint in the channel, by specifying the channel 
endpoint address. No other channel endpoints connected to the channel receive that 

10 data. 

An application 25 may join any number of sessions. For each session the application joins, 
it will seek to bind to a set of media channels previously specified to it by the 
communication session manager 14 in a media description, 

15 

The media description specifies the number and media type of channel instances in a 
session transport, and the connection details required to join the session transport (these 
connection details include the address and type of the session transport, and the 
authentication and authorization information required to join the session transport). The 

20 Session Description Protocol (SDP, RFC 2327) defined by the IETF is an example of a 
standard scheme that can be used to specify the media description. Other ways of 
specifying the media description are also possible, of course, - for example, the media 
description can simply identify the set of media clients to be instantiated by media 
applications, the address of the session transport, and the authentication information 

25 required to join the session transport. 

Typically, the application 25 creates one media client for every media type supported by 
the session. 

30 Leg Controllers Each conmiunication session instance maintained by the communication 
session manager 14 needs to be able to commxmicate with the endpoint systems 16 that 
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correspond to its session entities 12 in order to invite the endpoint systems to connect up 
with the session transport, and to monitor the states of connectivity of the endpoint systems 
and thereby the connection state of each session entity 12 to the communication session 
1 1. A small nximber of connection states are defined that model the stages of a session 
5 entity joining and leaving a commxmication session. The states correspond to the notions 
of inviting a called entity to a session, alerting the called entity of the invitation, connecting 
to the session transport, being in a state of connection to the session transport, requesting a 
disconnect from the session transport, and being disconnected from the session transport. 

0 The commimication between a session instance and an endpoint system 1 6 corresponding 
to one of its session entities 12 is effected through a pair of leg controllers20, one in the 
conmiunication session manager 1 4 and the other in the endpoint system 1 6. (The term leg 
is used because session diagrams, such as shovm in Figure 1, have a number of legs 
attached to a session body, each leg representing a participant). The leg controllers 20 
5 provide the signalling functionality and state machine functionality for inviting an 
endpoint system into a session transport and subsequently change and monitor the 
connection state of the entity. 

More particularly, to invite an endpoint system to connect up with a session transport, the 
inviting entity creates a leg controller and contacts the endpoint system at a connection 
endpoint 21 of the system (the connection endpoint provides a xmique address for the 
endpoint system and is used in a similar way as a telephone nimiber in the PSTN). This 
results in a corresponding leg controller being established at the endpoint system after 
which the pair of leg controllers exchange "leg messages" that carry a variety of data, the 
most important of which is the media description of the session transport which the 
endpoint system uses to set up media channels as already described. The state of 
connectivity of the endpoint system is also reported via the use of leg messages. As already 
indicated, the connection-state abstractions exchanged by the leg controllers represent 
high-level, logical participation in the session transport, and are independent of the 
commimication mechanism used by the session transport. Typically, the connection states 
are: 

For the inviting entity: 
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- an inviting state between when an invitation has been sent to an endpoint system to join 
a session and when a message is received back indicating whether the invitation has 
been accepted or declined and entered the estabhshed state; 

- a connecting state between the acceptance of the invitation by the endpoint system and 
when an indication is received that the endpoint system has connected to the session 
transport; 

- an established state between when the endpoint system connects to the session 
transport and either when the endpoint system disconnects from the session transport or 
the inviting entity sends a message to the endpoint system requesting disconnection; 

- . a requesting disconnection state between when the inviting party requests 

disconnection by the endpoint system and when disconnection is reported back; 

- a final state entered after disconnection has been reported from the endpoint system or 
the joining process fails before reaching the established state . 

For the invited endpoint system: 

■ an initial state up until when an invitation to join a session is accepted. The 
significance of this state may vary depending on the role of the endpoint system. Thus, 
where the endpoint system is the initiator of a communication service request, the 
initial state effectively corresponds to the period between when the request is issued 
and when an invitation to join a session is received back since the invitation will 
generally be automatically accepted by the endpoint system (note that the invitation 
may be either explicit or implied by the passing to the endpoint system of the 
information necessary to join a session). In contrast, where the endpoint system is one 
receiving an invitation which it did not instigate, the initial state lasts between when 
the invitation is received and when it is accepted by the human or automated operator 
of the system. In either case, the acceptance/rejection of the invitation is reported back 
in a leg message to the inviting system. 

a connecting state between the acceptance of the invitation by the endpoint system and 
when the endpoint system has connected to the session transport; 
an established state between when the endpoint system connects to the session 
transport and either when the endpoint system disconnects from the session transport or 
the inviting entity sends a message to the endpoint system requesting disconnection. 
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- a disconnecting state between when either the inviting party or endpoint system user 
requests disconnection from the session transport and when disconnection is achieved; 

- a final state entered after disconnection from the session transport or upon the joining 
process failing before reaching the established state. 

5 

Both leg controller instances only exist for the duration of the participation of the invited 
endpoint system in the session transport. 

The external interface to, and logical signalling used by, the leg controllers is independent 
10 of the mechanism used to transport the leg messages carrying the signalling information. 
Many different transport mechanisms for leg controller messages are possible. For 
example, Java Message Service (JMS) can be used or a system such as described in our co- 
pending patent application GB 9920834.0 filed September 4, 1999 that enables 
commimication to the customer desktop through a firewall. Internet protocol (IP) socket 
15 and Session Initiation Protocol (SEP) transports are other possible alternative 
implementation choices. 

By using the above mechanisms, a conmiunication session instance can implement the 
session operations by translating operations into a sequence of operations on instances of 
20 leg controllers to change the connection state of the affected session entities. The net effect 
of operations can be described in terms of a simple leg algebra of addition and subtraction 
of legs into the communication session and are reported in appropriate session events. 

Layered Model - Having described in turn the basic concepts and elements of the web 
25 interaction system, it is worth considering from a broader perspective the layered model of 
the system shown in Figure 3. This layered view organises the system into four layers, each 
representing a different logical view of the connectivity and communication between the 
various entities. 

30 The four layers of the model are described below: 

1 . The Service Layer represents the service logic written by application developers to 
intelligently conference session entities into a conmiunication session. A service 26 
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manipulates the connection state of a set of session entities 12 to a communication 
session 1 1 , using only the elements of the Commimication Session Layer. A service 
uses the communication session operations to invite entities to or disconnect them 
from the session, and uses the communication session events to monitor changes in 
connection state of the session entities. Many different services can be written, each 
using the underlying Communications Session Layer. At the service level, each 
endpoint system communicates with the service 26 via a service interface 29 that 
typically takes the form of service-specific web pages running in a browser 
application. 

2. The Communication Session Layer offers a high-level view of the participation of 
session entities 12 in a communication session 11. Users of this layer deal only 
with very high-level abstractions of participation in a conference. The 
commimication session 11, commiinication session factory 13, and session entity 
12 are the principal elements of this layer. The communication session Hand 
session entity 12 uses the leg controller 20to invite the remote participant to join 
the session transport 15. 

3 . The Connection Layer represents the protocol, messages, events, state machine and 
operations used to invite a participant 12/16 to a session transport 15, and 
subsequently manipxilate the connection state of the participant to the session 
transport. The leg controller 20 is the principal element in the connection layer. 
Connect and disconnect procedures offered by the connection layer are independent 
of the implementation mechanisms used for the transport layer. The connection 
layer elements use the operations, and consume the events offered in the transport 
layer. The events generated by the connection layer are used by the communication 
session layer to update the state of session entities 12 and the communication 
session 1 1 . 

4. The Transport Layer represents the elements involved the exchange of application 
data between session participants. The session transport 15 is instantiated by the 
commimication session 1 1 using the session transport factory 18. Channels 17 and 
channel endpoints 22 can be instantiated by any entity with sufficient privilege. For 
example, both entities in the connection layer and media clients can be authorised 
to instantiate channels. 
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The messages exchanged between functional entities in the connection layer can contain 
information from other layers, in addition to the specific information of the connection 
layer itself. Services in the service layer are able to pass arbitrary information as key- value 
5 pairs to session participants in the add and remove operations. The communication session 
layer uses the transport layer messages to send information to invited session participants 
describing the current state of the conmixmication session abstractions, allowing session 
participants to reconstruct the current view of the communication session layer. 

10 Service Scenarios 

The above-described architecture of the web interaction system allows considerable 
flexibility in how a request from a user to communicate with one or more other participants 
is satisfied. How the request is handled depends on the characteristics of the service 26 to 
which the request is directed, it being the service that controls what session is involved in 

1 5 the conmiunication (including whether this is a new or an existing session) and what other 
participants are invited to join the selected session. 

A service is embodied as fiinctionality for providing the desired service behaviour using 
the session resources available to it in the communication session manager 14 (session 
20 creation/destruction, the session operations described above for adding and subtracting 
session participants, and the feedback of session state information in event messages 
generated in response to session events). 

Before describing the mechanisms used for routing a call initiator to a session and inviting 
25 other participants to that session, a number of service scenarios will be outlined to illustrate 
the breadth of applications possible using the above-described conmiunications 
architecture. Three general types of services will be described, namely: 

One-to-one customer/CSR interactions where a customer wishes to interact with a 
CSR at a contact center; 
30 - "Shop with friends" where several people wish to conduct coordinated browsing; and 
"Page is Place" where concurrent visitors to the same web page can conunimicate. 
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In outlining the service scenarios, the following terms are used: 

• Text Chat. Each member of a session can type lines of text into a chat GUI at any 
time. These are sent to other session members in real time (which in practice may 
mean a delay of up to a few seconds) via a text media channel and displayed in a 
chat window, interleaved with the name of the person sending the text. 

• Page Push. The page corresponding to a WWW URL is displayed in a reserved 
browser window of each session member. A media channel is used to convey 
URLs between participants to the session. In a "Follow-Me Tour", clicking on a 
hyperlink on the page in the Page Push window results in all session members 
following that link in synchrony. Page Push, and its variants, is a way for session 
members to share WWW content. 

• Callback or Dialback. A Web session member can be called-back at their telephone 
number. This feature is common in telephony contact centers, and a telephony 
contact center will have dedicated hardware for terminating and routing incoming 
telephone calls to CSRs. This hardware will usually have the ability to originate 
calls, making it possible to set up a dialback call between a CSR and a customer. 
The capability of adding a dialback connection to an ongoing Web interaction is an 
example of hybridization between existing contact centers, which are oriented 
around telephony, and the next generation of Intemet Relationship Management 
centers which use Intemet technology for communication with a customer. 

• Deferred Callback. A customer is called back at a nominated time. 

Customer/CSR 1 : 1 Interactions A number of different interactions are possible and each 
can be considered as constituting a service. These interactions include: 

Online Help - A customer is browsing WWW pages belonging to an enterprise and wants 
to talk to a CSR in that enterprise. The page will have some kind of "Help" button 
hyperhnk which the customer clicks on. The customer browser then progresses through a 
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WWW dialog which makes it possible for the customer to identify themselves by 
submitting a small nximber of personal details (e.g. name, customer reference, email 
address etc). The customer browser then launches graphical user interfaces (GUI) for each 
of the media types used in a session. This will typically be page push, and text chat or 
5 voice chat. An available CSR is discovered, joins the session, and the customer and CSR 
can then begin to discuss the issue that caused the customer to request help. The session 
can be extended by inviting-in additional CSRs, and the "call" can be transferred to another 
CSR. The session can also be extended to include additional customers. 

1 0 Online Help with Dialback - As in the "Online Help" service, but the customer provides a 
Public Sv^dtched Telephone Network (PSTN) number so that the CSR (in fact, the 
telephone callback hardware referred to above) can dial back to the customer, so creating a 
voice channel in addition to the other communication channel. The PSTN, rather than the 
internet, is normally used for voice traffic because it provides a higher quality channel for 

1 5 voice communication than Voice over IP at the current time. 

Online Help with Deferred Dialback and Web Rendezvous - As in "Online Help with 
Dialback", the difference being that the customer wants to commimicate to a CSR at some 
future specified time. This is useful, for example, when all CSRs are allocated, or the 
20 customer wants to reserve a callback at a convenient time. The customer goes through the 
initial dialog, provides personal details including a telephone number, and is provided with 
the URL of a page to return to at a later time. When a CSR calls back by telephone, the 
customer goes to the specified page and is joined to a session to which the CSR is also 
invited. How this is achieved is described later in this document. 

25 

Deferred Dialback - The customer uses the initial WWW dialog to select a telephone 
callback at a specified time. No web interaction session is created, and the Internet is not 
used as a commxmication technology. 

30 Web Rendezvous - The customer is speaking with an CSR over the telephone and decides 
to do a web based communication for page push or chat. At this point the CSR presses the 
"Rendezvous" button which will generate a session identifier/password for the CSR to give 
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to the customer. The customer goes to a URL that is the "Rendezvous page" and is joined 
to a session to which the correct CSR is also invited. How this is effected will be described 
later onin this docxmient 

5 Shop with Friends (Figure 4)- This scenario assumes that two or more friends want to 
browse and make purchases online. They want to conmaimicate with each other using text 
or audio chat, and see the same WWW pages in a "Follow Me'* tour as described above. In 
Figure 4, three friends 12J,K,L are depicted as viewing the same web page together, 
discussing its content (via an audio media channel), and they have invited a CSR 12X to 
10 answer some questions. From the customer perspective this scenario is identical to the 
"Online Help" scenario, with the exception that the session members are customers and not 
a mix of customers and CSRs. How a "Shop with friends" session is established and the 
parties joined to it will be described hereinafter. 

15 It is to be understood that the label "Shop with Friends" is used herein simply for 
convenience and it will be appreciated the techniques described herein relating to the 
"Shopwith Friends" scenario are also applicable to other group sessions between users that 
are not in the privileged positions of CSRs or other parties having special access to the 
interaction service system. 

20 

"Page as Place" (Figure 5) - The "Shop with Friends" scenario uses a fixed multi-party 
session, and a succession of WWW pages "flow throw" the session using foUow-me page 
push. Session participants effectively wander around the WWW, the session maintaining 
its coherence as it travels. An altemative is the "Page as Place" scenario, where a 

25 communication session is immutably associated with a specific web page. In this scenario, 
as customers move from page to page, they move from session to session. Figure 5 shows 
four women 1 2J,K,L,X looking at two different pages 30A and 308, each being associated 
with a respective session 1 1 A, 1 1 B . The woman 1 2L is viewing page BOB and is in session 
1 1 B by herself The two women 1 2 J,K are both viewing page BOA and are therefore in the 

30 same commimi cation session 1 IB and can commxmicate with each other via appropriate 
media channels; these women 1 2J,K have been joined by a third person 1 2X - a CSR who 
is monitoring activity on page BOA. 
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The advantage of this scenario is serendipity: it corresponds closely to what happens when 
a person wanders around a mall, meeting a different set of people in each shop. Wandering 
into a page showing lawnmowers, one can choose to see whether anyone else is also 
5 looking at lawnmowers, and engage them in conversation. One might see a CSR just 
"standing aroimd" on the page, or one could listen in on what a CSR was telling another 
customer. 

There is a great deal that can be done with this simple concept. Instead of thinking of a 
1 0 WWW site as a catalogue, it can be organized like a department store or a mall into a set of 
places - the perfume department, the coffee shop, ceramics, cooking and so on. Instead of a 
customer having to decide whether their query is important enough to justify contacting a 
CSR, they can see CSRs "standing aroxmd" when they move from page to page. It is not 
considered an imposition to approach an idle sales assistant in a shop even for the most 
1 5 trivial of queries, because we know that is what they are there for. 

Session Routing 

A description will next be given, with reference to Figure 6, of how a party at an endpoint 
system 16 initiates participation in a service-specific communication session. For 
20 simplicity, in the following, no distinction is made between endpoint system 1 6 and the 
participant party using the system. 

In general, the initiating party 1 6 will be requesting a specific service that is centred around 
a particular target subject such as a person, page, catalogue item, or any other concept that 
25 is meaningful both to the requesting party and the routing functionality that handle the 
requests. The selected service will involve communication with another participant or 
participants who are in some way associated with the target subject. The process of joining 
the desired commimication service for the requesting party is a two-step routing process: 
The first step is to select a commxmi cation session 1 1 for the initiating party 16 to 
30 join on the basis of factors such as the service selected, the target subject £ind the 

requesting party. The selected session will be either a pre-existing session or one 
created for the new call; in either case, there is an associated service instance 26 
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providing the service specific behaviour associated with the selected session. This 
first step is carried out by session initiation fiinctionality 35 which creates a 
temporary initiation instance 37 for routing the requesting party to the appropriate 
session with the aid of session routing functionality 46. Of course, the operation of 
adding a party to a session is initiated by the session service instance so that, in fact, 
the result of the session routing step is to pass the details of the requesting party to 
the session service instance which then takes care of initiating addition of the party to 
the session. Nevertheless, it is still appropriate to refer to this routing step as a 
session routing step since what is of interest is the identity of the session to be joined 
- thus in the situation of there being more than one session associated with a service 
instance (as is potentially possible with complex services), the routing fimctionality 
serves to identify to which session the requesting party should be routed, the identity 
of the session being passed to the service instance to enable it to initiate adding the 
party to the right session. 

The second step (which is not always needed) is to extend the participants in the 
commxmication session 11 by selecting one or more other parties to invite to the 
session. 1 1 . The second step is carried out by the service instance 26 associated with 
the selected session. 

More particularly, when a requesting party 1 6 selects a specific service via a web interface 
in their browser 29, they are passed service-specific pages 34 fi-om a web server 33 that 
provides a service firont-end. These pages, and associated server-side scripts and servelets, 
are used to collect data about the requesting party, service options, target subject etc, which 
is passed to a service-specific initiation instance 37 that was created (by fiinctionality 36) 
in response to the initial selection of the service concerned by the requesting party. This 
initiation instance 37 resides on the commvini cation session manager 14 and its identity is 
returned to the server 33 so as to enable data collected fi"om the party 16 to be correctly 
passed back to the instance 37 (by way of example, this identity could be held in an 
endpoint-system-specific session object on the server 33 with session cookies, including a 
unique requesting-entity identifier, being used to Hnk received HTTP requests fix)m system 
16 with the session object). The initiation instance 37 is operative first to carry out a data 
collection and collation task 38 to establish enough information to enable the right 
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communication session to be selected, and (if appropriate) the right participants to be 
invited to join; this body of information is herein called the initiation context 40. 
Collecting the information necessary to complete the initiation context 40 is primarily done 
through the web pages 34 but may also involve lookups in a customer database 39 holding 
information about the requesting party, and potentially other relevant databases. 

The information contained in the initiation context 40 will to some extent be service 
specific but will generally involve information grouped into the following data sets: 

1. Requesting party. This data set is used to describe the characteristics of the 
requesting party. Examples are the name, e-mail address, physical address, country of 
origin, telephone number, gender, and profession. Other attributes could relate to 
preferences of the requesting party, such as an interest in sport and music. An 
important (though not necessarily essential) attribute of the requesting party is a 
unique user identifier, used by the system to identify the requesting party, and used as 
a key to database 39. Typically, this unique identifier is created the first time the 
requesting party visits the site, and identifies the requesting party for all subsequent 
interactions with the site (for example, it is stored on the requesting entity's system in the 
form of a cookie.). 

2. Communication endpoint system. This data set is used to describe the commimicating 
device 1 6 used by the requesting party, for example the media capabilities and name 
of the device. 

3 . Target Subject. This data set is used to describe the entity the requesting party wishes 
to establish a commimication session with. For example, the abstract entity may 
simply be ^customer service representative', with additional attributes that describe a 
marketing campaign such as *Vacuum cleaners*. 

4. Service data. This data set is used to describe additional information required by the 
specific service associated with the selected called abstract entity.. For the example 
of the 'customer service representative' abstract entity, described by the 'Vacuum 
cleaners* campaign, the service data could correspond to a specific product range, 
feature set, or price range. 
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5. Communication option. This data set describes the preferred communication 
mechanism of the requesting party. The requesting party may wish to commimicate 
by Internet or non-Intemet channel, or some combination of the two. Non-Intemet 
channels could be telephone, or fax. Internet channels represent a variety of 
5 multimedia data types such as text or voice chat, collaborative web browsing, 

Internet voice and video telephony. Often the communication option is service- 
specific. For example, the requesting party may want to communicate with other 
individuals with similar interests, with a customer service representative, or with an 
automated bot. The commvmication option may relate to the immediate or fiiture 
1 0 establishment of a conmiunication session, depending on the service concerned; thus 

the communication option could comprise a desired future commvmication time, 
specified by the requesting party. 

The sets of parameterised data, described above, are derived and collated ft*om several 
15 sources: 

• Referrer URL The URI of the page that held the link to the first service-specific 
web page 34 for a particular service can provide valuable information as it 
represents a simplification of the browsing history of the requesting party. The 
Referrer URL can be extracted fi-om the HTTP header when requesting party first 

20 attempts to establish a communication session 

• Embedded in a Web page 34. The Web page(s) 34 returned to requesting party 16 
and used to request the establishment of a commxinication session, may contain 
arbitrary amounts of embedded data in the form of name- value pairs. The data may 
be statically embedded in the page, or dynamically generated by active server 

25 technology, such as Java Server Pages (JSP), as understood by those skilled in the 

art. For example, a page may contain parameters that describe high-level semantics 
of the page, such as the product sales campaign and a specific model mmiber This 
data is extracted and passed back fi-om the requesting-party browser 29 in the 
request for a conmnmication session to the web server 33 and firom there to the 
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initiation instance 37. The data may be visible or invisible to the requesting party, 
the decision is made by the web site designer. 

• Input by the requesting party. The requesting party may be presented with an 
HTML form to input information about him/herself (name, e-mail address, postal 
address, coimtry, telephone number, age, gender, profession, and interests), to 
describe the communication option required (such as text chat, voice chat, page 
push, shared whiteboard, hitemet voice, hitemet video, and PSTN telephone call), 
or to select the target subject. 

• Persistent data in requesting party browser, hiformation can be stored in the 
requesting-party browser 29 (i.e. in "cookies"), to describe or simply identify the 
requesting party, to maintain service state, or requesting party preferences. 

• Persistent information held centrally. Requesting party information (such as name, 
address, country^ telephone number, or service subscription options) can be 
persistently stored in the database server 39. The requesting party identifier is used 
as the key to the appropriate database entries. Also of interest can be the earlier 
browsing history of the requesting party through the pages of an enterprise website 
prior to making the service request. This history is called a 'Svake" and is stored in 
a Wake Repository. 

Once the initiation context information has been collected, the initiation instance 37 
executes a session routing task 45 with the aid of the session routing functionality 46 (task 
45 is effectively a client of the session routing functionality 46). The session routing 
function consists of intelligent services to analyse the initiation context and decide whether 
to select an existing session in the session pool 31, or to create a new session and 
associated service instance (this it does by instantiating a new service instance 26 of the 
appropriate type using service-instance factory 47, the service instance then using session 
factory 1 3 to create a corresponding conmiunication session instance 11). An identifier of 
the selected service instance and session is returned to the task 45 by functionality 46. 
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In certain situations, the requesting party may be able to identify specifically a session to be 
joined by a session identifier. In such cases, the session routing task (and, indeed, 
potentially also the use of a session initiation instance) can be by-passed; however, the 
session routing task can usefully still be called upon in order to check that the provided 
session identifier relates to a current session. 

Upon the session and service instances being identified, the initiation instance 37 hands on 
subsequent processing of the service request to the service instance 25; in particular, the 
service instance is informed that a new participant, with associated initiation context 40, 
wishes to join the related session. The service instance in accordance with its specific 
behaviour, now causes the requesting party to be invited into the selected session 1 1 (task 
50) with the details of the party and other relevant context information being provided to 
the session. The mechanism, previously described, for inviting an entity to join a session is 
to use the appropriate session operation to add the party to the session with the session then 
creating a leg controller 20 through which it sends out an invitation to a connection 
endpoint of the target entity to invite the latter to join the session, the receipt of this 
invitation causing the target entity to instantiate a leg controller to converse with the 
session leg controller. However, since the requesting entity 16 cannot be relied upon to 
have the appropriate functionality to instantiate a leg controller 20 at this stage, either the 
passing of a joining invitation fi-om the session leg controller must be delayed until the 
required functionality is provided to the requesting entity and the corresponding connection 
endpoint address is communicated back to the session, or else an alternative invitation 
mechanism must be used. In one such alternative mechanism, after the selected session 1 1 
has created a corresponding leg controller 20, the address of the latter and the session ID 
(which can be in the form of a name/password pair) are passed to the requesting entity 1 6 
(or, as will be seen, its proxy) via the communication path already established with the 
requesting entity through the service fi-ont end 27 (see chain-dashed arrow 5 1 ). The passing 
of this information effectively constitutes an invitation to the requesting entity 16 to join 
the session which it now does by creating a leg controller 20 and connecting with the 
corresponding leg controller previously established by the session 11. Leg controller 
functionality can be provided to the requesting entity 1 6 either by being passed to the entity 
16 in the forai of an applet fi-om the service fi-ont end 27, or by having the latter act as a 
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proxy for the requesting entity with the leg controller functionality being part of the proxy 
functionality. 

The media description of the session transport associated with the selected session is now 
5 passed to the requesting entity 16 by the session (unless this was previoxisly done when 
passing the session ID and leg controller address to the entity) and the requesting entity 
proceeds to establish appropriate media channels with the session transport instance (the 
latter having been previously created by the session instance 11). 

10 Depending on the nature of the service, upon the requesting party joining the selected 
session, one or more further participants can be automatically invited into the session by 
the service instance 26 on the basis of the information contained in the initiation context 40 
the current state of the selected session, and the nature of the service concemed. One 
typical example would be the invitation of a specialist CSR into a session in the case where 

15 the service was online contact with a CSR about a specialist topic. Figure 6 shows the 
service instance as carrying out task 52 to identify an appropriate additional participant to 
invite to the session, this task making use of a participant resource 54 (for example, a 
contact center management system for identifying the next available CSR suitable to 
handle the subject of interest to the requesting party). Once an appropriate additional 

20 participant has been identified, that participant is invited into the session (task53). 
Frequently, the invited participant system is one, such as a CSR desktop system, that is pre- 
configured to form part of the web interaction system and is therefore provided with 
appropriate functionality - in particular, with persistent leg-controller instantiation 
functionality at a known connection address. In this case, the join invitation is issued 

25 through a corresponding leg controller 20 of the session to the known cormection address 
of the participant system, thereby causing the instantiation of a leg controller in the 
participant system followed by an exchange of leg messages as already described above. 
The invitation includes data that describes the customer (or other participants in the 
communication session) so that the CSR can quickly identify the customer and the context 

30 of the call. 
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In certain situations, the participant to be invited into the session may be specifically 
identified by the requesting party. In such cases, the participant routing task 52 can be by- 
passed or else simply used to confirm that the identified intended participant is currently 
valid. 

Note that although in the foregoing the selection of an additional participant was initiated 
by the join event of the requesting party 1 6, task 52 could equally well have been triggered 
immediately following session selection whereby the invitation into the session of the 
participant effectively occurs in parallel with the invitation to the requesting party. The 
addition of a participant may also be initiated in the course of a session by an earlier-joined 
participant 

The foregoing discussion whilst dealing in general terms with how any requesting party 
joins a session and invites a fiirther participant into the session, concentrates on the 
scenario of the initial requesting party being a party (such as a customer) that has no special 
fimctional relationship with the web interaction service (and therefore needs to be provided 
with the means for joining the session), whereas the party being invited to join the 
requesting party in the session is a CSR that has fimctionality allowing them to be more 
directly invited by the session. It is worth considering fiirther the other possibilities 
regarding joining/inviting into a session, namely a CSR joining themselves to a session, 
and the inviting in of a customer to a session. (Note that the discussion here concerns what 
is happening at the service level in terms of parties joining themselves to a session and 
inviting in others - at the level of the session instance itself, all parties are 'invited' to join 
session as instracted by the service instance, the method of invitation simply differing 
depending on the capabilities of the party being invited as described above). 

If a CSR wishes to join a session without having been invited in by an existing participant, 
then, of course, the CSR can use the service fi-ont end (service-specific web pages) like 
other parties, though it is preferable to have an option which is specific to CSRs in order to 
avoid unnecessary data collection and to provide a way of indicating to the service instance 
that the party to be joined is a CSR and can therefore be invited directly through a leg 
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controller message (due to the leg initiator fimctionality present at the CSR end system). 
However, since the CSR endpoint system is closely associated with the interaction service 
system, it is also possible to provide a more direct interface to the commvmication session 
manager 14 from the CSR endpoint system, by-passing the service front end; this interface 
could be the same interface as used by the service front end in communicating with the 
CSM 14 or another interface. In this case, the CSR endpoint system need only send a 
message to this interface indicating that the CSR wishes to join a particular session (the 
latter being identified either in terms of a target subject or a specific session identifier 
where a specific, existing, session is to be joined). 

An example situation of a CSR wanting to join a specific session without invitation is 
where a valued customer is noted to have just joined a "Page as Place" session being cared 
for by the CSR (this scenario is more fully described hereinafter with reference to Figure 
24). 

As regards the- inviting of a party (not a CSR) into an existing session, it will be 
appreciated that the problem here is that the party may not even be cxirrently browsing the 
web. hi such cases, some other commxmication channel must be used to ask the customer 
to link up to the web interaction service system (for example, at a 'rendezvous page') and 
join themselves to the session concerned, the party having been given an identifier of the 
session. An example of this type of situation is the inviting of a 'fiiend' into a "Shop with 
Friends" session. 

After a party has joined a particular session, it may be useful for the party to be able to 
interact with the service instance (one example is where a CSR wishes to transfer a 
customer to another CSR by having the service instance find an appropriate CSR and then 
trigger the transfer operation of the session instance). The service front end provides one 
route by which session participants can communicate with the service instance (to the 
extent permitted by the service-specific pages and the specifics of the interface defined 
between the service front end and the communications session manager). In this case, the 
session ID is all that is needed to link any participant input to the appropriate service 
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instance 26. This enables participants to invite further participants, such as a CSR into a 
session at any appropriate time, the tasks 52 and 53 being executed on the basis of existing 
information and any new information supplied with the invite request. 

5 However, a second route is now also available for contacting the service instance, namely 
by using the leg messages exchanged with the session leg controllers to carry messages for 
the service instance; the details of how this is implemented will depend on the specific 
technology used for passing the leg messages but appropriate implementations are within 
the competence of persons skilled in the art. This route may only be enabled for CSRs if it 
1 0 is desired to tightly control access to the service instance functionality for parties who are 
not CSRs (the service front end being a good vehicle for providing control of what features 
of the service instance are accessible). 



CSRs may also have a third way of accessing the service instance where the CSR endpoint 
1 5 systems can send message directly to the CSM interface as outlined above. 

From the foregoing, it will be appreciated that the session and participant routing 
functionality of the web interaction system is highly flexible, allowing a requesting party to 
join a specific session or a session appropriate to a particular subject, and to invite in one 
20 or more specific or generically identified further participants, either at the time of joining 
or later during a session. The way in which a party (whether the party requesting to join a 
session or a party to be invited into a session) is actually invited into a session is dependent 
on whether the party already has the appropriate functionality for joining and participating 
in a session or whether that functionality needs to be provided to the party. 

25 

Specific Embodiment 

Figure 7 shows one arrangement of equipment for implementing an embodiment of the 
above-described web interaction system in the case of a customer 60 connecting across the 
Internet 63 to an enterprise web server 64 and wishing to initiate web interaction services, 
30 including commimication with a CSR via CSR desktop 74. As will be appreciated by 
persons skilled in the art, the names and quantities of servers hosting the web interaction 
services are shown for the purposes of illxistration and clarity, and should not be read as 
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determining a unique physical instantiation of the architecture. There are many physical 
configurations that can satisfy the architecture, and the choice usually comes down to non- 
functional criteria such as performance, scalability, reliability, security etc. However, in 
broad terms, it can be seen that the web interaction system comprises endpoint systems 
5 (customer and CSR systems 60, 74) that can establish multi-media commxmication with 
each other using the services of a web interaction service system 64-70 that embodies the 
service fi-ont end 27, communication session manager 1 4, and session transport manager 1 9 
of the Figure 3 layered functional diagram. 

10 , 

More particularly, the customer has a desktop system (for convenience embraced by 
reference 60) which is connected to a LAN 61 located within a customer firewall 62. It is 
common in many organisations to use a firewall to isolate the private intemal network fh>m 
^the public Internet for security reasons. The customer 60 could be a domestic consumer 
1 5 connected to Intemet 63 via an Internet Service Provider (ISP) or it could be an employee 
of an organisation with a high level of intemal security, such as a bank or a hospital. The 
customer 60 is connected through the customer premises firewall 62 to the Intemet using 
the standard Intemet TCP/IP protocol, and the customer has World Wide Web access using 
the standard Hypertext Transfer Protocol (HTTP). 

20 

The enterprise web server 64 is connected to enterprise LAN 66A which connects to 
Intemet 63. Web server 64 resides within the so-called "demilitarized zone 65" of the 
enterprise, this being a ring- fenced LAN which includes equipment that is controlled by the 
enterprise but is accessible to the outside world as well as to equipment on the secure part 
25 of the enterprise network (LAN 66B) that exists behind a firewall. 

In browsing the pages served by the enterprise server 64, the customer decides to request 
an offered web interaction service and indicates this by an appropriate selection action that 
results in a corresponding HTTP request message being sent to the web interaction system, 
the fi-ont end of which (functionality 27 of Figures 3 and 6) is embodied in a session 
30 mediation server 67 that also lies within the DMZ 65. Other equipment components of the 
web interaction system include a Communication Session Manager (CSM) server 69 
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providing the functionality of the communication session manager 14 of Figures 3 and 6, 
and a Thin Client Group Communications (TCGC) server 70 providing the session 
transport functionality 19 of Figure 3 ("Thin Client" is used to refer to the approach 
whereby most of the functionality resides in a server). The servers 69 and 70 both reside 
5 behind the DMZ 65. More details of the implementation components of the Figure 7 web 
interaction system are given below. 

Thin Client Group Communication Server 70 - This component can be implemented, for 
example, using Sun's Java Shared Data Toolkit (JSDT). One or more TCGC servers 70 can 

10 be instantiated, to provide scalability. The TCGC server exports a simple interface to the 
session transport factory 18 (Figure 3) to allow other functional entities to create and 
destroy new session transports. The session transport is created with a set of authorisation 
parameters which are passed across the factory interface. In the current embodiment, 
session instances 1 1 residing on the CSM server 69 are the only authorised clients of the 

1 5 session transport factory interface. 

The session transports 15 provided by the TCGC server 70 are centrally managed. The 
TCGC server is responsible for authenticating entities that attempt to perform operations 
on the session transport 15, channels 17 and channel endpoints 22. In particular, session 
20 transport creation and destruction, creating or obtaining a reference to a channel, and 
binding a channel endpoint to a channel, are all operations that need to be authenticated by 
the TCGC server 70. The TCGC server has full knowledge of the set of channels 17 
created in a session transport, and the set of channel endpoints 22 bound to the channels, 

25 Commxinication between channel endpoints 22 is implemented using a unicast transport. 
The originating channel endpoint 22 sends data to the TCGC server 70, and it is the server 
that forwards the data on the unicast transport to each of the destination channel endpoints 
22 for the channel concemed. 

30 Communication Session Manager Server 69 - The CSM server 69 provides the platform 
on which the functionality is deployed to create and manage conmiimication sessions and 
their associated service instances. The realisation of the initiation instances 37, service 
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instances 26, communication sessions 11, communication session factory 13, and server- 
side leg controllers 20 are part of the CSM. The CSM holds the definitive view of the 
communication session state. 

5 In the current embodiment, the CSM offers a Java RMI remote interface to allow Java 
Servlets running on the SMS (see below) to create and communicate with instances of the 
services deployed on the CSM. 

Session Mediation Server 67 - The Session Mediation Server (SMS) 67 is a web server that 
1 0 hosts the set of service-specific pages that present the GUI to allow a requesting party to 
request connection to a service-specific communication session concerning a target subject. 
The GUI allows the requesting party to select a service, enter personal information, select a 
communication option, and describe the entity to communicate with. In the current 
embodiment, the server is, for example, an Apache Web Server (http :/ / www. apache. org) 
1 5 running the Jserv (http://java.apache.org) Java Servlet environment. Java Servlets running 
on the CSM server are used to parse WWW forms and validate customer inputs, and these 
servlets use the above-mentioned RMI interface to the initiation and service instances 
running on the CSM to satisfy the conmixmication requests of the requesting party. 

20 Other Components - The web interaction system also includes other components 
connected to the enterprise LAN 66B, these being a customer database server 39, 
additional information servers 7 1 , a contact center management server 72 for providing the 
CSM 69 with information regarding the availability of CSRs in CSR pool 73 (the CSRs 
and their desktop systems being indicated by references 74 in Figure 7) 

25 

Interaction Scenario 

Figure 8 depicts the communication protocols used between the above-described system 
components. These protocols include the following, all are layered on top of the standard 
TCP/IP protocol: 

30 • Hypertext Transfer Protocol (RFC1945). This is the protocol used by WWW browsers to 
access WWW servers for the purpose of providing the WWW service. This protocol is the 
lowest-common-denominator means for customers to interact with the web interaction system. 



0 

33 

and it can be transported securely across corporate firewalls. The customer desktop system 60 
uses this protocol to commimicate with the enterprise web server 64 and the SMS server 67. 

• Java Remote Method Invocation (RMI) (see http://javasoft.sunxom) is a well known 
protocol used to invoke methods on remote objects in distributed systems. It is here 
used between the SMS server 67 and the CSM server 69 for invoking service and 
session initiation operations provided by the CSM. 

• Java Message Service (JMS) (see http://javasoft.sun.com) is a public specification for 
inter-computer messages which has been widely implemented to disguise various 
proprietary protocols, and is a convenient way to specify and implement interactions 

• between the CSM 69 and TCGC server 70, as well as between the CSM and back-end 
servers such as databases 39 and 71, call centre manager 72, and CSR desktop 
applications 74. 

The following scenario illustrates the use of these protocols during the initiation of a basic 
and familiar service where a customer 60 browsing the WWW wants to contact a CSR 74 
to ask questions. The service takes information about the customer, creates a 
communication session, invites the customer into the session, locates an available CSR, 
invites the CSR into the session, and once both parties are in the session, they can begin to 
interact using various media. The general interactions involved are referenced [ 1 ] to [8] in 
Figure 8 and are as follows: 

{1] The customer 60 is browsing the enterprise WWW site on server 64 (using HTTP 
protocol) and wants to talk to a CSR 74 about some issue. The customer finds a 
**help" button on the WWW page currently being viewed and clicks on it. This button 
is a hyperiink to a WWW page on the Session Mediation Server 67. 

[2] The customer goes through various hypertext/WWW dialogues on the Session 
Mediation Server (SMS) 67. This involves selecting various communication options, 
and the customer supplies a small amount of personal information. The servlet 
running on the server 67 also extracts information about the customer in the form of 
"cookies" and other information fi-om the HTTP header request, as already described. 

[3] The SMS 67 condenses all the information about the customer in the form of a Java 
object and communicates it to a service-specific initiation instance on the CSM using 
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the Java RMI protocol (as an alternative to passing all the required information in 
one go, this can be done progressively as the SMS collects information). There may 
be additional communication (using the JMS protocol) between the SMS/CSM and 
extemal database 39 containing customer information, so that the information 
presented to the customer can be personalised according to the past history of 
interactions. 

[4] The initiation instance on CSM 69 causes the creation of an empty commxinication 
session 11, with associated service instance 26, for the customer. The session 
instance 26 commimicates (using the JMS protocol) with the TCGC server 70 to 
create a session transport 15. 

[5] Information about the session (including session identity) and the session leg 
controller corresponding to the customer are then returned via the SMS to the 
customer along with the customer interface to the session (including leg controller 
functionality and the other functionality to be a member of a session) as part of an 
HTTP response (i.e. a WWW page containing active content such as Java or 
Javascript). In this way the customer loads a WWW page which contains information 
about the selected session transport. 

[6] The customer system 60 joins the session 1 1 by using the leg controller functionality 
passed to it to contact the corresponding leg controller on the CSM server 69. 
Because of the difficulties involved in traversing the customer's firewall, the leg 
messages passed between the leg controllers actually use the same transport 
mechanism as employed for the media channels, namely a firewall traversing 
protocol, such as that described in our co-pending patent application GB 9920834.0 
filed September 4, 1 999, depicted by a chain-dashed line in Figure 8. Indeed, the leg 
messages can conveniently be passed across a channel established for this purpose 
between the customer end system and the session transport 1 5. To this end, the media 
description is passed to the customer system along with the session identity via the 
SMS whereby the customer system can establish conmiunication with the session 
transport 1 5 using a firewall-crossing protocol and set up a channel to pass the leg 
messages as well as the required media channels for each of the media types in the 
session. 
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[7] The service instance 26 on CSM 69 interacts with the contact center manager 72 

(using JMS) to select an available CSR. 
[8] The service instance 26 causes the CSR desktop system 74 to be invited to join the 

session, the invitation being issued through the relevant session leg controller using 

the JMS protocol. This invitation contains customer information. 
[9] If the CSR accepts, the CSR desktop system 74 joins the session transport using the 

same protocol as the customer desktop system. 

At this point, both the customer and CSR can exchange information using media channels 
created as elements of the session transport 1 5. The CSM 69 monitors the status of the end 
system participation in the session transport via the leg controllers, and when either 
customer or CSR leave, it tears down both the communication and session transport. 

Although in step [5] above, the SMS is described as passing the customer system the 
functionality needed to join and be a member of a session, as a collection of Java applets 
and Java packages in a WWW page, this functionality could be retained at the SMS with 
the latter acting as a proxy for the customer system and only serving to that system WWW 
pages that reflect the service/session state as known to the proxy (see "Lite Desktop" 
description below). 

This physical infrastructure is capable of supporting many service scenarios such as those 
described above. 

Endpoint System Desktops 

Examples will now be given of GUI desktops suitable for a CSR endpoint system 74 and a 
customer system 60, these desktops being the visible expression of the functionality 
described above. In particular, the desktops provide interfaces for the media channels 
associated with a communication session as well as web interfaces to the web interaction 
service 26 concerned; additionally, the CSR desktop provides tools for managing multiple 
"calls" (communication sessions). 
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CSR Desktop (Figures 9-17) 

The CSR Desktop 80 is the CSR's sole point of interaction with web channel calls but may 
be used in conjunction with other channels, e.g. telephony, to offer richer service, e.g. 
voice and page push. A CSR is associated with one or more campaigns which are a way of 
5 breaking down a customer service problem space into smaller logical areas; typically, a 
specific campaign will constitute the target subject matter of a customer service request. A 
campaign is also a means to organize CSRs into skillsets - it is an administrative 
mechanism with explicit support in the contact center management system so that a single 
contact center functions as a set of smaller virtual contact centers, each with a defined topic 
10 focus 

In telephony, interaction between a customer and CSR is swift and if the CSR wishes to 
split their attention between two or more calls, they must put one of the calls on hold, thus 
breaking the appearance of dedicated service. With the web channel, interaction can be 

15 less intense, e.g. if the customer is not familiar with a keyboard, and there is opportunity 
for an CSR to multi-task between a number of calls. To support the illusion fi-om the 
customer*s perspective that the CSR is giving them dedicated service requires a CSR 
desktop GUI component that enables the CSR to manage the information and media 
associated with each call quickly and effectively. Figure 9 shows an example CSR desktop 

20 GUI 80 with a call-management component 82 that can be used by the CSR to receive 
incoming calls and manage calls that they are already dealing with. Each call (a session 
that the CSR is invited to, is currently involved in, or has recently left) appears as a row in 
a table containing relevant information such as customer name, customer ID, the campaign 
this call belongs to and the status of the call. To interface with a particular call, the CSR 

25 selects the row containing the call details (and possibly is also required to press an 
appropriate button). 

The call management component 82 includes a set of high-level control buttons 8 1 for 
choosing actions such as accepting/rejecting an invitation to join a session, disconnecting 
30 fi-om a call, transferring the call to another CSR and conferencing in another CSR 
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The CSR desktop 80 also comprises a cxistomer-interaction component 83 with respective 
GUI sub-components for each of the media types that the desktop 80 is intended to handle 
(albeit that not all media types are present in all calls). These GUI sub-components are 
5 generically called media-type windows below with the sub-components associated with a 
specific media type being referred as that media-type window. In the Figure 9 example, a 
text-chat window 85 is shown together with a page-push window 86 and a browser 
window 87 (the latter two windows both being used for a page-push channel, the browser 
window showing the page at the last-pushed URL as displayed in the page-push window 
1 0 86). Upon a call being selected in the call-management window 82, the media clients 
established for the call are linked to the corresponding media-type window. 

Example media-type windows are shown in Figures 10-12. More particularly, Figure 10 
shows a text-chat window 85 in the case where no call has been selected, whereas Figure 
15 11 shows the same window 85 when a call, with previous chat dialogue, has been selected. 
Figure 12 shows the page-push window 86. 

Figure 1 3 depicts the general arrangement of functionality supporting the CSR desktop 80. 
A central control block 90 comprises leg controller functionality 91 , and a session manager 

20 92 for managing the sessions in which the CSR desktop system is involved. When the leg 
controller functionality 91 receives a leg message inviting the CSR desktop system to join 
a session, it creates a corresponding leg controller in the alerting state and causes the 
session manager to create a new line in the call management window 82. This line is 
emphasised in some manner (e.g. shown in red) to alert the CSR to the invitation (see sole 

25 line in the call-management window depicted in Figure 14). Upon the CSR accepting the 
call by selecting the line and clicking an accept button, an appropriate icon is added to the 
status field of the call line ( see Figure 1 5) and the session manager 92 instantiates media 
clients 24 for the media types indicated in the media description of the session. These 
media clients then set up corresponding media channels to the session transport as already 

30 described. The state of the leg controller passes to ^connecting' during channel set up and 
then to ^established' once the channels have been set up. 
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For whichever session is currently selected (the currently selected session is highlighted in 
blue with only one call being in a selected state at one time), the session manager causes 
the media-type windows 85 - 88 to display the output of the corresponding media channels 
of the selected session. Each user interface function is disabled or enabled depending upon 
5 the status of the currently selected session to ensure that the user is only presented with the 
options relevant at any given moment; in particular, if a particular media type is not 
required for a selected session this is clearly indicated and the relevant window controls 
disabled (see Figure 16 that shows the text chat window 85 when not being used for a 
currently-selected session). 

10 

While dealing with one call, some new content may appear on the media channels 
associated with one of the other calls being handled by the CSR. When this occxirs, an icon 
representing the media type of the new content is displayed in the call table's media 
colunm. This simple mechanism enables a CSR to concentrate on interacting in one 

15 session in the safe knowledge that they are not missing input from another customer. As 
soon as the media icon(s) appear, they can select that call and check what has happened, 
making a response as necessary (when a call is selected, all media icons are cleared from 
the call's display). Using this process, a skilled CSR should be able to handle a number of 
calls simultaneously. 

20 ^. „ 

When the customer or CSR drops the call, the call details do not disappear inmiediately. 
Instead, the call table entry remains (see second row in the call management window 82 
shown in Figure 1 7) and, if the call is selected, the media- type windows can be used by the 
CSR to review the content generated when interacting with the customer. When the CSR 

25 is happy that they have captured all the information they need, the call can be removed 
from the call table and the media content is lost forever (unless archived). 

Scripts - CSRs often have to deal with the same types of enquiries over and over again. To 
extract the most relevant information as efficiently and as qxiickly as possible, a CSR will 
30 often ask a series of predefined questions. These are conmionly placed into written scripts 
which are either followed from top to bottom, or sampled as necessary. When using 
telephony this is sufficient. However, when presented with a medixmi of interaction such 
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as text-based chat, the CSR is required to type repetitive phrases and questions in addition 
to the usual conversational pleasantries. The menu bar 95 in the Figure 1 1 text-chat 
window 85 shows two scripts that are represented by pull-down menus 96, 97. The first 
menu 96 (labelled "General Phrases") contains commonly used phrases such as **Hi, how 
5 can I help you?", and so on. The second menu 97 (labelled "Hoovers") contains questions 
that are specific for the campaign related to the call, e.g. "Hoovers". As a CSR flicks from 
one call to another, the correct campaign script is automatically displayed in the text-chat 
GUI. 

1 0 Similar pull-down menus 98, 99 are also available in the page push window 86 (see Figure 
12) and contain URLs in much the same way as browser provide a bookmark facility. 
These URLs are again ordered for general campaign-independent use (menu 98) and 
campaign-specific relevance (menu 99). Selecting one ofthese URLs will push the page to 
the session. 

15 

A CSR in using the script-enabled text chat and page push windows to show a customer 
aroimd a product, for example, would say (type in the text chat window 85) something or 
choose an entry from a script menu, and then select the appropriate URL from one of the 
menus 98, 99 in the page-push window 86. It is also possible to arrange for the selection of 
20 particular text-chat script entries to automatically cause a corresponding URL to be sent to 
the page push media client of both the CSR and customer. 

The above-described use of predefined selections, as well as their linking together across 
media types, can be applied to all media clients, whereby a multimedia presentation is 
25 effectively scored by the selection of script items. 

Languages - In addition to being assigned to one or more campaigns, a CSR may also be 
multi-lingual and capable of dealing with enquiries in multiple languages. The country and 
language (together making a ''locale") of the party requesting contact with a CSR is 
30 captured with the other data about that party and is passed via the SMS and CSM to the 
CSR desktop as part of the inviting leg message from the session leg controller to the 
central control block 90 of the CSR desktop. If the CSR chooses to accept the web call. 
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then this information is saved by the central manager 90. Whenever the relevant session is 
chosen by the CSR, the session identity and locale is passed to the media channel user 
interfaces 85 to 88 to enable session-dependent portions of these interfaces to be adapted to 
the locale of the currently selected session on the basis of locale-dependent data 89 
5 accessible to the interfaces. Thus, by way of example, in the case of the text chat window, 
the menu bar 95 will display script names and their contents in the appropriate language. 
Session-dependent parts include character sets, date/time conventions, scripts or other pre- 
defined content intended to be pulled in during the session, and so on. Those parts of the 
media channel user interfaces that are not session-dependent are always presented in the 
10 CSR desktop locale as is the call management component 82. The CSR desktop locale can 
be selected to be either the chosen default locale of the call centre, or the CSR's native 
language. 

Pre-defined, locale-dependent content, e.g. scripts, can be pulled in at run-time if the CSR 
15 desktop receives a session fi-om a locale for which it does not have the appropriate 
session-dependent data. This allows the allocation of multi-lingual CSRs to change at run- 
time. 

The initial capture the locale of the requesting party can be done in any appropriate 
20 manner. For example, where the requesting party initiates contact by clicking on a help 
button appearing on a web page on the enterprise server 64, then the locale information can 
be associated with the button and passed to the SMS 67 for incorporation in the session 
context; if the website is split into language specific regions, then there is only need for one 
help button on a page, whereas if there are no specific regions in the site, then multiple 
25 help buttons can be provided, each one coded for a different locale. Of course, locale 
information could simply be captured along with other participant data as part of a form- 
based dialogue after the help button is pressed. Another way of obtaining locale 
information is for the SMS or CSM to use customer identity information to look up locale 
information for the customer in a customer profile database. 

30 

Whilst the locale information is described about as being passed to the CSR system at the 
time the latter is joined to a session, where the CSR is first into a session, the locale 
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information of a subsequently joining customer could be passed to the CSR system at the 
time the customer joins. An altemative is to arrange for the session or service instance to 
supply the locale information only upon selection of a session by the CSR using the call 
management component 82. 

As well as benefiting CSRs in contact centres, the dynamic adaptation of interface 
elements to locale can be applied to the application of the web interaction system to 
situations such as moderating a virtual commimity or an online training class. 

Call Operations - Control buttons 81 (see Figure 17) make available the following basic 
call-handling functions to a CSR : 

Answer - (button 81 A) Accepts the selected call and connect to the session. 

Decline - (button 8 IB) Refuse the selected call such that another CSR will be selected 
to take it. 

Drop - (button 81C) Used when CSR has finished dealing with the customer. 

Transfer to CSR - (button 8 ID) Transfer the call to another specified CSR. If the 
receiving CSR accepts the call the desktop waits until all the receiving desktop's 
media clients are connected before automatically disconnecting their own for that 
call. 

Conference to CSR - (button 8 IE) Sometimes, a CSR may wish to conference in 
another CSR, for example one with more knowledge on a certain matter. If the 
receiving CSR accepts the call, then the session is extended to include that CSR's 
media clients. As long as there is one CSR dealing with the call, the 
communication session will remain open. 
Clicking a control button 81 results in the session manager 92 initiating the appropriate 
action, including the sending of leg messages to the CSM server 69 to notify the session 
instance 1 1 of a change of communication state of the CSR desktop system (for Answer, 
Decline, Drop actions), and the sending of messages to the service instance 26 to 
add/remove participants (Transfer/Conference actions). 

Customer Desktop 
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The customer endpoint system 60 provides a customer desktop interface for interfacing the 
customer with the service being provided by the web interaction system. The following 
description of the customer desktop relates to the specific case of a desktop configured for 
customer-CSR interaction and it will be appreciated that for other service scenarios the 
precise details of the desktop will vary to suit the service. 

The customer desktop typically proceeds through the following connection states that are 
reported to the communication session manager in leg messages: 

an initial state entered on launching of the desktop and ending when an invitation is 

received and accepted firom a session; 

a connecting state between acceptance of the invitation and when the appropriate 
media clients have been set up and media channels established to the session 
transport; 

an established state made up of a routing sub-state lasting whilst a CSR is being 
foimd and invited into the session, and a conversing sub-state lasting whilst the 
customer and CSR are both connected to the session (the leg messages only report 
the established state and not its sub-states); 
a disconnecting state, and 
a final state. 

The CSR may transfer the call to another CSR. If this happens the customer desktop is 
informed and the customer informed so that they do no anticipate any fiirther interaction 
until the call has been successfiiUy transferred. 

As with the CSR desktop, the customer desktop preserves the relevant media content, e.g. 
the chat transcript, after a call has terminated so the customer can review the information 
they gathered after the CSR has disconnected. 

The Customer Desktop is composed of two layers: one providing service-level logic and 
fimctionality (the service interface 29 of Figure 3), the other implementing the media 
clients with their graphiceil user interface. Two fiinctionally similar embodiments of the 
customer desktop are described below, namely: 
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an applet-based customer desktop ("ACD") implemented, for example, using Java 
applet technology ; the ACD requires downloading to the customer endpoint system 
and carries out media channel processing on the customer desktops; and 
a proxy-using customer desktop (the "Lite" customer desktop, LCD because no 
download or extensive processing is required on the client side, the processing being 
done in a proxy provided in the SMS 67). 

Applet Customer Desktop (ACD) 

The general functional structure of the ACD is shown in Figure 1 8 and, as can be seen 
comprises a web browser 1 00 in which standard HTML pages (with embedded JavaScript) 
provided by the SMS 67 provide the service interface 29, whilst the browser's Java Virtual 
Machine 102 runs a downloaded applet 103 to offer a richer interface to the web 
interaction system. 

The ACD is laimched when the SMS 67 serves an HTML page containing the applet to be 
opened in the cxistorrier's web browser (this is normally done after initial information has 
been collected, using HTML forms, by the service front end running on the SMS 67). The 
parameters for the HTML applet tag specify session information needed to initialise the 
desktop and connect to the session leg controller (on CSM 69) and the session transport 
TCGC server 70, these parameters typically including: 

- Customer identifier. 

- Nickname (from the form filled in by the customer prior to desktop launch). 

- Language the customer requested to receive service in. 

- Address of the commimication session associated with the call. 

- The response to be given when challenged by the TCGC upon joining the session. 

- The media description for the given session. 

The first action performed by the applet 1 03 is to interpret the media description and create 
a media client 24 for every media type contained therein. All the media clients 24 are 
connected, via transport layer 106,to the session transport at the given address and use the 
given response when challenged. At the same time, a single CSM client 1 05 is created and 
a connection with the CSM established, via the session transport 1 5, for the passing of leg 
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messages to communicate comiection state infomiation to the session instance 11. As 
already indicated, the transport layer 106 preferably implements a firewall-crossing 
protocol. 

The ACD's user interface is initialised so that input and output are suitable for the 
specified language and media GUIs created for the respective media clients. In this way, 
the user interface only contains those GUI elements that are strictly necessary for a given 
call. 

The ACD uses an interface defined in Javascript to perform operations on and reflect 
certain events into the HTML document containing the applet. These events can be used 
for synchronising web content with the desktop. Just as the applet uses Javascript to access 
the HTML document, so Javascript can be used by the document to access the external 
interface of the ACD, e.g. get the current state of the desktop. For example, where a page- 
push media client is instantiated, this can cause the opening of a browser window to be 
used to displaying the pages pushed by the page push media client. Upon receipt of a new 
URL fi-om the page push channel, the page push media client invokes a Javascript method 
to display the URL in the page push window. 

Lite Customer Desktop (LCD) 

The general arrangement of the LCD and associated proxy is shown in Figure 1 9. The LCD 
uses HTML and Javascript in the web browser 1 00 and locates the media-client and leg- 
controller functionality 24, 1 05 in the SMS 67 (again, this fimctionality can be implemented 
using J ava code 1 08 running in JVM 1 09). When the LCD is launched (done by the SMS 
67 serving the appropriate HTML pages to the customer system 60), a desktop proxy 
process 109 is created in the SMS that connects to the TCGC 70 to set up the required 
media channels and interacts with the session leg controller on the CSM 69. The LCD 
forwards any user input, e.g. chat message, page to push, etc., to the proxy 1 09 and polls it 
using an HTTP request for client updates, e.g. change in desktop state, new chat messages, 
page to display, etc. 
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Whilst the media clients for the LCD are located at the SMS, the media channels 
effectively extend to the customer desktop itself 



5 Further Interaction Scenarios 

Figure 8 depicted the main operations involved in setting up a 1 : 1 session between a 
customer and CSR using the Figure 7 web interaction system. The Figure 7 system is 
capable of handling significantly more complicated scenarios as will be described below, 
this being possible due to the flexibility offered by the combination of the generic, service- 
10 independent, functionality of the communication session, and the service instances that 
define service behaviour in terms of simple leg algebra executed through the basic 
operations provided by the communication session. 

Customer : CSR scenario - Transfer and Conference, 

15 For conference, a new CSR is added to the session. An existing CSR in a session uses 
desktop button '8 IE to activate functionality enabling the existing CSR to specify the 
characteristics of the CSR it is desired should join the current session. This information is 
then sent to the session service instance at the CSM 69 (for example, carried in leg 
messages that indicate the information is for the service instance). The service instance 

20 contacts the contact center manager system 72 to determine which CSR to invite into the 
session. The identified CSR is then invited into the session in the normal way using either 
the "Add" operation of the session or a special "Conference" tailored for such situations. 
An alternative approach is to have the CSR desktop system first contact the contact center 
management system itself to get the identity of the CSR to be invited into the session, and 

25 then to arrange for the CSR system to be able to initiate the session conference operation 
itself 

For transfer, the initial steps are the same as conference (but with desktop button 8 ID 
being used so as to enable a transfer request to be distinguished from a conference request). 
30 However, upon a new CSR being identified, the "Transfer" operation of the 
communication session is used to invite the new CSR into the session, the existing CSR 
being disconnected by the session upon receiving a leg message from the new CSR desktop 
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indicating that the latter is in the established state. 



Customer : CSR scenario - Deferred Rendezvous, 

In a number of situations it is desirable to be able to establish a session, at some later time, 
5 between a CSR and a customer who has been browsing the enterprise web. For example, 
for various reasons (such as contact center congestion, customer preference, or to avoid the 
customer paying for the call), the customer may be given or may specify a time when the 
contact center is to call back by telephone and a customer: CSR session established. This is 
the Deferred Callback Service with web rendezvous, previously mentioned. 

10 

So far as the customer is concerned, joining the session should be accomplished with 
minimum customer input and in a secure manner. To this end, the service is implemented 
as will now be described with reference to Figure 20 in which the main steps are referenced 
by numbers in square brackets. 
15 [1] When the customer is browsing the Web and requests help, if the customer selects 
the deferred callback option from the Help web page , a further web page is served by 
the SMS 67 for the customer to enter his or her telephone number, the callback delay, 
and other items of information. This form is then submitted back to the SMS. 
[2] The details are extracted from this form and used as the initiation context for creation 
20 ofa new session and corresponding deferred-rendezvous service instance in the same 

general manner already described above with reference to Figure 6. 
[3] At this time, the service instance does not seek to populate the session but, instead, 
returns a secret identifier to the SMS that vmiquely identifies the service- 
instance/session. The customer information is stored with the session. Preferably, the 
25 session does not initiate the creation of a session transport at this time (this can be 

achieved by designing the generic session such that it only requests session transport 
creation after the receipt of the first Add operation request from the corresponding 
service instance). 

[4] The customer is then returned an HTML page by the SMS 67; in essence, this page 
30 instructs the customer "Go to this **rendezvous" page, bookmark the page, and when 

you receive your callback telephone call, go to the book-marked page". Assuming 
that the customer follows the instructions, the customer then goes to the rendezvous 
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page and bookmarks it (that is, stores the URL - or more generically- the URI of the 
rendezvous page as indicated by bookmark 111). Loading the rendezvous page (which 
is served by the SMS) causes a "cookie" to be set on the customer's machine in 
respect of the rendezvous page. As is well known to persons skilled in the art, a 
5 "cookie" permits name/value pairs to be encoded in an HTTP response header sent 

from a Web server to a Web browser, and the browser will normally (this capability 
can be turned off) store these values in a file for a period of time specified in the 
cookie; during this period, any request for the page in respect of the which the cookie 
was created will result in the cookie being returned to the server in the HTTP page 
1 0 request message. In the present case, the cookie includes the secret session identifier 

passed to the SMS by the deferred-rendezvous service instance. This happens 
transparently to the customer though the identifier could also/altematively be 
explicitly displayed (or otherwise presented) to the customer. 

[5] The service instance 26 also places the deferred rendezvous request in a list 1 10 of 
1 5 pending callback requests, the request entry in the list including the session identifier 

and desired callback time. This list is periodically scanned by a rendezvous monitor 
daemon running on the CSM as indicated by arrow 112. 

[6] When the rendezvous monitor recognises that it is time to initiate callback, it notifies 
the corresponding service instance. 
20 [7] The service instance 26 now uses the services of the contact center management 
system 72 to identify an appropriate CSR having regard to the details previously 
elicited from the customer (deferred rendezvous contacts will generally be given 
priority over normal customer assistance requests). 

[8] The service instance then causes the session 1 1 to invite the identified CSR into the 
25 session (thereby triggering creation of the session transport). The CSR accepts, fully 

joining the session and connecting to the session transport. 

[9] The service instance then uses the standard functionality of the contact center 
management system 72 to place an outbound telephone call to the customer at the 
telephone number previously provided by the customer and stored with the session. 
30 At the contact center, the call is routed to the selected CSR. 

[10] When the phone rings, the customer goes to the previously bookmarked rendezvous 
web page which results in the cookie stored on the customer's machine being 
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returned to the SMS (it may be noted that by appropriately setting a parameter in the 
HTTP header in the Response message that previously served the rendezvous page, it 
is possible to ensure that the page is re-loaded from the SMS rather than retrieved 
from a local cache on the customer's machine). 
5 [11] Either immediately, or after the customer has clicked a connect button on the 
rendezvous page, a script on the SMS extracts the secret session identifier from the 
returned cookie and informs the corresponding service instance that the customer has 
made contact. 

[12] The service instance then proceeds to join the customer to the session in the manner 
1 0 • already described (c.f. arrow 5 1 in Figure 6) with appropriate media interfaces being 
created on the customer's desktop and connected to the session transport. 

On joining the session, the customer finds that a CSR is already there, ready to assist. 

15 It will be appreciated that the deferred rendezvous service is not dependent on the customer 
actually picking up the callback telephone call or, indeed, on the callback telephone call 
being made at all (though it is often convenient for the customer and CSR if such a call is 
made as a trigger for the rendezvous). Thus, the customer could simply be required to 
return to the rendezvous page at a particular time in order to be connected to the session, 

20 the CSR either being already present or invited upon the customer joining the session. 

Security is provided by the use of a secret identifier to link the party making the renewed 
contact with the previously captured customer details. Additional security can be provided 
by giving the identifier a limited period of validity such as a 1 5 minute window either side 
25 of the allotted rendezvous time. 

It will also be appreciated that a number of variations are possible in the implementation of 
the above-described deferred rendezvous service. For example, the creation of a service 
and session instance could be deferred until the customer returns to the rendezvous page 
30 provided that provision is made for storing the customer information between the initial 
contact and the customer's return and for linking the secret identifier with this information. 
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Also in this case, the secret identifier would need to be generated, for example, by one of 
the service front-end pages running on the SMS rather than by the service instance. 

As aheady noted, the secret session identifier could be explicitly declared to the customer 
in which case the customer could be made responsible for going to the rendezvous page 
(not necessarily previously bookmarked) and entering the identifier into a form presented 
on that page, submission of the form then having the same effect as clicking on the 
"connect" button in the earlier described implementation of the deferred rendezvous 
service. Although such an arrangement has the advantage that it is not dependent on the 
customer being willing to accept cookies (as was the case for step [4] of Figure 20), it is 
not very convenient for the customer. A fiirther alternative is to include the session 
identifier in the query string of the rendezvous page URL so that bookmarking of the page 
also stores the session identifier and subsequent recall of the bookmarked page will result it 
the session identifier being returned to the server in the request URL query string. To 
achieve this, after the customer has submitted the context form, the customer is returned an 
intermediate page that includes a link to the rendezvous page, the link URL having a query 
string incorporating the session identifier. 

In another variant, the CSR is specifically identified at the time the deferred rendezvous is 
set up (for example, the customer may have been allotted a particular CSR for handling 
their enquiries in which case the identity of this CSR is collected as part of the initial 
context information - indeed, the timing of the deferred rendezvous could be set in 
dependence of the availability of the identified CSR). In this case, step [7] of the above 
process can be by-passed. Furthermore, since the data identifying the CSR is short, it could 
be stored in the cookie (or query string) held at the customer system rather than in the 
context data held at the service systern. 

The method described in the foregoing paragraph of establishing a fiature communication 
session with a particular CSR can also be used to effectively continue, at a fiiture time, a 
current session between a CSR and a customer; in this case, the customer, when requesting 
the future session using a request form brought up by clicking a special button displayed on 
their desktop, does not need to input the identity of the CSR, this identity being 
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automatically included by the CMS 69 in the context data for the follow-up session (or 
included in the customer cookie). The context data for the follow-up session can include 
other relevant context data from the current session and also the identity of any 
transcription Bot (see below) that may have been joined to the session whereby upon the 
parties joining the follow-up session, the last content items recorded by the transcription 
Bot can be brought up in the media channel interfaces. 

Customer : CSR scenario - Extending a Telephone Session by Web Rendezvous 
Since the current dominant method for a customer to contact an enterprise for help is to 
dial an 800 number, it would be useful to be able to add in web interaction to an existing 
telephone interaction between a customer and CSR. The following service, described with 
reference to Figure 21, provides this facility. 

[1] When the customer makes a telephone call to a contact center, a CSR is allocated to 
the call by the management system according to any appropriate set of criteria. 

[2] As the CSR converses with the customer over the telephone, they agree that it would 
be useful to supplement the telephone channel by adding a web based communication 
for page push or chat. At this point the CSR clicks on a "Rendezvous" button on the 
CSR desktop which returns a session name (handle) and a password for the CSR to 
give to the customer (the session name concerns a session yet to be established and is 
not an identifier of an existing session). In the preferred embodiment of the service, 
the session name is simply the CSR's local name. The session password is generated 
dynamically by the CSM 69 as a one-time ticket in response to a request received 
from the CSR desktop as a result of the clicking of the Rendezvous button. This 
request also includes the aforesaid session name, and the session-namerpassword pair 
are stored on the CSM in a list 1 1 5 associated with the generic service. The password 
takes the form of a short string of digits which can be read out to the customer over 
the telephone. 

[3] Using the telephone channel, the CSR now instructs the customer to go a 
Rendezvous page associated with the service (this page being one served by the SMS 
67) and enter the session name and password into an HTML form. 
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[4] When the form is submitted the two pieces of inforaiation (session name, password) 
are extracted by a script running on the SMS and passed to a newly created service- 
specific session-initiation instance running on CSM 69. The session initiation 
instance checks the session name and password against the stored list 1 1 5 of such 
5 pairings and if this check is passed, the session initiation instance uses the session 

routing function to create a new session and corresponding service instance to which 
it hands over control. 

[5] The customer is then invited to join the session in the manner already described 
above (c.f arrow 5 1 in Figure 6). 

1 0 [61 At the same time the CSR is also invited to join the session. The CSR is known to 
the service instance because this is one of the pieces of information returned by the 
customer (as the session name) to the SMS and passed, via the session initiation 
instance, to the service instance 26. Of course, there will generally be a step of 
mapping the CSR name as provided in the returned session name, to the operative 

15 identity of the CSR's system (this identity could be stored in the list of session- 

namerpassword pairings, the identity being provided by the CSR system when 
initially contacting the CSM for the password). 

As can be seen, the session is set up as per a normal session except (a) it is the CSR, rather 
20 than the customer, that initiates the process by clicking on the rendezvous button; and (b) 
the CSR invited into the session is the CSR that the customer is already talking with, there 
being no need for the normal CSR selection procedure. 



It is possible also to create the commimication session earlier in the process (for example, 
25 when the session name and password are generated) and add the CSR to it in the 
expectation that the customer will join the session - indeed, this can be done even before 
the customer indicates a desire to conununicate via a web channel. In this case the session 
name is more truly that, that is, an identifier of the session rather than of the CSR (though, 
of course, identifying the session also indirectly identifies the CSR) , 

30 

In step [3] the session name and password need not be verbally passed to the customer 
(though this is generally the simplest way of proceeding); for example, using an acoustic 



52 

coupler between the customer's telephone and the customer's endpoint computer system, 
the session name and password could be send as a binary signal using tone signaling or 
other appropriate method for transmitting data over a phone line. 

5 The use of a password is desirable but not essential, though if no separate password is 
provided, the session name preferably includes a one-time component of limited validity 
that is checked by the CMS before connecting the customer into a session with the CSR. 

Shop with Friends — Basic scenario 

10 The Figure 7 system can also be used to run services that are not centered around contact 
with a CSR, including a "Shop with Friends" service such as previously described with 
reference to Figure 4 . The multiparty, multimedia, sessions available using the described 
web interaction system are well suited to provide such a service, with the page-push media 
GUIs 86,87 enabling the group of friends to browse web pages together and the text chat 

1 5 GUI 85 (or other media channel interface such as an audio interface) enabling the friends to 
exchange comments. A major characteristic of the "Shop with Friends" service is how the 
parties are brought together in the same session, that is, how a rendezvous is achieved. This 
is done as follows (see Figure 22). 

[1] One person in the group ("the leader") selects the "Shop with Friends" option on a 
20 web page on the enterprise server 64. This results in service-specific pages being 

served from the SMS 67 to capture basic context details. 

[2] A new session and associated service instance are created by the CSM 69 and a 
session transport established, all in the same general manner as previously described. 

[3] The leader is then joined to the session. 
25 [4] Dxiring the session setup a secret session identifier in the form of session 
name/password text strings is created, either by the service-specific web pages served 
by SMS 67 or by the service instance 26 itself. The secret identifier is stored, for 
example, on CSM 769 in a list 1 20 for such identifiers, and also conununicated to the 
group leader. 

30 [5] The leader now commxmicates the secret identifier to all the other group members in 
any suitable manner, for example by e-mail, by an instant messaging service, by 
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telephone, or by using a pre-arranged group page (pass-worded) where group 

members can meet and swap information using simpler tools. 
[6] When a group member receives the secret identifier, he or she goes to a specific web 

page hosted by the Session Mediation Server and submits the secret identifier 

(session name and password). 
[7] The submitted session identifier is is checked against the stored secret identifiers and 

if a match is found, the corresponding service instance (identified through the session 

name included in the secret identifier, possibly with a level of indirection) is 

informed. 

[8} The group member is then invited into the session in the manner already described, 
resulting in the loading of the customer desktop and joining of the session. 

Joined members then use foUow-me page push to view the same WWW pages, and media 
channels to interact. 

Shop with Friends — Inviting a CSR into a group browsing session 

A group of fiiends is browsing the Web together and interacting as described previously 
for the Shop with Friends scenario. They decide they want to invite a CSR into the session 
to provide advice. To this end, the customer desktop for this service is provided with an 
"invite CSR'* button 122 (the customer desktops are provided by the SMS and specific 
desktops can be served for specific services). Any member of the group can press the 
"invite CSR" button at any time. 

When the button is pressed (step [1] in Figure 23), an HTML request is sent to the SMS 
and contains the secret session identifier for the session, along with additional context 
about the page currently being browsed, etc. The "Invite CSR" request plus context is 
passed to the service instance 26 which contacts the contact center management system 72 
(step [2]) to identify an available CSR appropriate to participate in the group session. The 
CSR is then invited to join the existing session in the normal way as described elsewhere 
(step [3]). 
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The same mechanism can be used to invite a helper Bot (see below) into the session or any 
other assistant entity such as a background music assistant for playing backgroimd music to 
participants in the session. 

5 Shop with Friends — Follow-up sessions 

A group of friends is browsing the Web together and interacting as described previously 
for the Shop with Friends scenario. They decide they want to meet up again later to 
continue browsing together. To this end, one of the group selects a "future rendezvous" 
option from a drop-down menu in the page push window 86, thereby moving the group to a 

10 ftiture rendezvous set-up form page in browser window 87. This page enables one of the 
group to enter details of a desired future group rendezvous and submit the details (for 
example, in a URL query string). The submitted details are processed by a server-side 
script and the future rendezvous time is confirmed back first to the submitter in a future- 
rendezvous meeting-point page; at the same time, a cookie is passed to the submitter 

1 5 including a session identifier for the future session (already created or for which details 
have been stored at the service system). This process is closely similar to steps [1] and [2] 
of -the Figure 20 deferred-rendezvous process. The other members of the group are then 
also passed the future-rendezvous meeting-point page and associated cookie as a result of 
the URL of this page being pushed to them by the page-push mechanism of the submitter. 

20 The pushed URL includes (as a query string parameter) an identifier that enables a server- 
side script associated with the meeting-point page to recognise that it is being asked to 
return .the intended meeting time for a particular session and to set a cookie with the 
session identifier. 

25 The group members now each bookmark (set as a favourite) the meeting-point page (as 
per step [4] of the Figure 20 process). Some or all of the group members may now leave 
the group session. 

Subsequently, at the agreed time, some or all of the group members meet up again in a new 
30 session by going to the book-marked meeting-point page resulting in the cookie stored for 
this page being sent to the service system along with the page request. The group members 
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then connect up to the session identified in the cookie in the same way as already described 
for steps [10] - [12] of the Figure 20 process. 

Of course, it would be possible to retain the initial session identifier for re-use as the 
5 identifier for the follow-up session. However, it is preferable change the session identity 
each time for security reasons. 

Where the session identity is changed between sessions, it may nevertheless be desirable to 
provide a chain of session identifiers that can be followed to enable a group member who 
1 0 misses a group meeting to catch up with the latest session. Thus, if a group meets regularly 
each day, if a member misses a day and therefore does not have a cookie with the session 
identity for the following day, then by linking the session identifier of the missed day to 
that for the following day, the member can still connect to the following day's session 
using the cookie-carried session identifier for the missed day. 

15 

The context data for the follow-up session can include relevant context data fi-om the 
current session and also the identity of any transcription Bot (see below) that may have 
been joined to the session whereby upon the parties joining the follow-up session, the last 
content items recorded by the transcription Bot can be brought up in the media channel 
20 interfaces. 

Page as Place - Basic scenario 

The Figure 7 system can also provide a "Page as Place" service such as described above 
with reference to Figure 5. By way of example, the Page as Place service may be offered 

25 for a group of related web pages (such as a store guide), these pages being hosted, in the 
simplest case, on SMS 67 and each having a respective associated session to which parties 
landing on the page are automaticaUy invited. When a party first loads one of these pages, 
they can be asked a few details about themselves using web form pages loaded fi-om the 
SMS, this information being at least temporarily stored for use when joining each new 

30 page session (this step is optional). The party is then invited to join the session associated 
with the page first landed on and is provided with the customer desktop to enable that party 
to interact with other parties already present in the session (if any). Thepage session can be 



56 

maintained even when there are no participants present or destroyed immediately no 
participant is present or after a delay (this 'no-participant' behavior is detennined by the 
service instance associated with the session); where no session exists when a new party 
arrives on the web page, a session and corresponding service instance are created in the 
usual manner. 

Each time a party moves from one page to another, the party is removed from the session 
associated with the old page (this can be triggered, for example, by using a JavaScript 
client-side JavaScript function in the old page that is triggered by the page unload event to 
notify the SMS) and added to the session associated with the new page (as a result of a 
server-side script in the new page served by the SMS). In one implementation, the 
customer desktop is reloaded each time a session is joined, this being part of the standard 
implied invitation procedure described above. However, this continual re- writing of the 
customer desktop is not desirable and it is preferred that after the first serving of the 
customer desktop, the change to a different page providing the Page as Place service 
simply causes: . 

- the customer desktop to destroy the leg controller associated with the previous page, 
and 

the SMS, in inviting the party to join the session associated with the new page, to 
serve only that information necessary to cause the creation of a new leg controller for 
contacting the corresponding leg controller of the session concerned. 

As a result, the media GUIs are retained as the party moves between pages and the 

corresponding "Page as Place" sessions. 

The customer desktop for the Page as Place service is preferably configured to provide an 
overview of who else is currently browsing the same page. One way of providing this 
information to the customer desktop is to arrange for the service instance to notify the 
desktop of each session participant whenever a party joins or leaves the session. This can 
be done, for example, by having the service instance use a dedicated media channel to 
which the desktops have connected (it being possible for the service instance to use the 
channel because it has access to the session which knows the address of the session 
transport). An alternative is to have the SMS serve pages with current group member 
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details to a special browser window of the desktop (the desktop periodically requesting the 
latest page). 

The "Page as Place" pages can be hosted on the enterprise server 64 rather than the SMS 
5 67 provided that the SMS is notified when a page is loaded by a customer. This can be 
readily achieved by incorporating a compact graphical element in the page, this element 
needing to be fetched from the SMS. Retrieving the element from the SMS results in the 
running of a script on the SMS which extracts the referrer URL (i.e. the page identity) 
from the HTTP request header and notifies the CSM that a new person has entered that 
10 page. 



Page as Place - CSR alerted to Valuable Customer 

This is a service provided by the web interaction service system to CSRs (and similar 
privileged parties) to automatically recognize visitors to a Web site that are of potential 

15 interest in the context concemed. This can be expressed as a service for notifying a CSR 
(or other privileged party) when an event or combination of events becomes true on a Web 
page hosted by an enterprise server. Typically, the triggering event / event combination 
would be the viewing of a particular page by a preferred customer. As an example, a site 
selling cars might place triggers on pages for high-ticket item cars (anyone viewing such a 

20 page being de facto a preferred customer). Another example is that of a site with a 
customer profile database where a CSR is to be notified whenever a "gold" customer enters 
the site. 

This alerting service is provided by using the 'Page as Place' service in conjunction with 
25 customer data (extracted, for example, from a customer profile database). More 
particularly, customers who have had previous transactions with the enterprise are 
allocated a customer identifier in the form of a cookie. The cookie is returned to the web 
server when the customer returns to the enterprise site, and the customer identifier is 
extracted from the cookie and used to access a database to obtain data about the customer. 
30 In this way, it is possible to compile a table of customer and page data each time a page is 
accessed, the table be updated as customers load and unload pages (the latter event being 
detected using a Javascript "onUnload" function when the customer leaves the page). The 
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table can be continuously scanned to ascertain when particular alert trigger conditions are 
met. 

A more detailed example will now be given with reference to Figure 24. Suppose a CSR 
associated with an automobile sale website wants to be notified whenever a *gold' 
customer (as specified in the customer profile of the business running the website) views a 
web page 1 24 showing a particular model of automobile. This page is set up as a Tage as 
Place* web page with the basic behavior described above. The web interaction service 
system is provided with an alert system 125 into which CSRs can set alert triggers 126 
each including a set of criteria defining a trigger condition (typically, page identity and 
customer attribute or attributes) and the identity of the CSR to whom the alert is to be sent 
when the trigger criteria are met. The alert system also includes a real time database 127 
for tracking for each page being monitored, the cxistomers currently viewing the page and 
selected details about them. A process 128 scans the database entries and seeks to find 
matches with the current set of triggers 126; if a match is found, the indicated CSR is 
notified. The alert system 125 can be implemented in any suitable manner - for example, 
the system could be run on the SMS and provide a web-based interface to the CSRs, 
enabling them to add / edit / delete triggers -126 and receive alert notifications. 

A typical sequence of events is as follows: 

[1] The CSR enters the trigger criteria to be met (in this case, *gold' customers viewing 
page 124). 

[2] A 'gold' customer lands on page 124 resulting in the page ID and the customer's 
related cookie being passed to the SMS where the customer's identity is extracted 
and passed with other context data to the CSM 69 

[3] A session initiation instance associated with the page and customer then accesses 
customer profile database 39 to extract customer data (including 'gold' status); the 
accessing of database 39 can alternatively be done by the SMS 67. 

[4] The session initiation instance routes the customer to the appropriate page service 
instance and the customer is added to the associated session in the manner previously 
described. 
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[5] Upon the session and its associated service being notified that the customer has 
successfully joined the session and session transport, the service instance notifies the 
real time database that the identified customer with particular attributes (in this case, 
including *gold* status) has joined the session for page 124 (identified by an 
appropriate attribute such as its URL, page title, etc.). A corresponding entry is made 
in the database, this entry preferably being scanned by process 128 at this time for a 
match with any of the alert triggers 126. Alternatively, the process 128 scans the new 
entry as part of a periodic scanning of the triggers currently in the database. Upon a 
trigger being matched, the process 128 notifies the CSR concerned and also marks 
• the database entry with the fact that this CSR has been notified (in order to avoid 
repeat notifications on the same trigger). 

[6] The CSR, on receiving the notification fi-om the alert system, decides to join the 
session concerned and sends a join request to the associated service instance (the 
session identity is passed to the CSR as part of the notification). The join request can 
be passed via the SMS or via a CSM message interface that gives CSRs a more direct 
access to the service instances . The service instance then initiates the joining of the 
CSR to the session after which the CSR can communicate with the customer using 
the established media chaimels. 

Rather than joining the customer in the page session, the CSR may choose an alternative 
communication method (such as e-mail or ordinary post) or decide to take no action. 

A trigger can relate to a combination of entries - thus, for example, the CSR in the above 
example may only want to be notified when at least three 'gold* customers are present on 
page 1 24. The process can check for this as each new entry is added to the database 1 27 or 
may be arranged to periodically scan the database in respect of "combination" triggers. 
Periodic scanning of the database also enables time-dependent criteria to be checked - for 
example, a CSR may only want to be notified of 'gold' customers joining page 124 after a 
certain time of day, or may only want to be notified if a *gold' customer dwells on page 
124 for more than two minutes (in this case, the database entry is time-stamped on being 
added to the database 127 so as to permit dwell time to be calculated). 
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Whilst in the above example an entry was only made in database 127 once the customer 
had connected to the page session, the updating of database 127 can be effected at an 
earlier stage in the process - for example, where the SMS is responsible for accessing 
customer profile database 3 9, it can also be made responsible for updating the database 1 27 
5 at the same time as passing context information to the CSM. 

The alert system is most likely to be useful in situations where customer information is 
available; however, this information need not necessarily be obtained from a customer 
profile database but could be obtained directly fi-om the customer as part of a context data 
1 0 collection process carried out when the customer first lands on page 1 24. In the latter case, 
the use of a cookie is not essential; altematively, a cookie could be used to store the 
required customer data, though this is not preferred for privacy reasons. 

Whilst the alert system is capable of handling complex trigger conditions, it can also be 
15 used for very simple triggers such as informing a CSR whenever any customer joins a 
particular page; however, this may not be particularly useful use of a CSR's time. 

Page as Place - CSR overviews and can Join 
20 In many situations it will be useful for a CSR or CSR supervisor to be able to have an 
overview of all ongoing sessions associated with pages, and to be able to join a session. 
This can be achieved using the same type of real-time session/customer database 127 as 
described above with reference to Figure 24. 

25 More particularly, a sessions overview subsystem 150 (see Figure 25) is provided with a 
real time database 127 of substantially the same form as described above and updated by 
adding and removing entries, again as already described. The overview sub-system is, in 
the present example, provided as part of the SMS 67 and includes functionality 151 
(typically server-side scripts) for dynamically generating web pages in dependence on the 

30 current content of database 1 27. In particular, functionality 1 5 1 is operative, on request, to 
generate a web page listing current page sessions and their associated participants. A CSR 
uses the overview sub-system as follows: 
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[1] CSR requests the session-overview web page using the CSR desktop browser; 

overview sub-system returns the overview page for viewing by the CSR. 
[21 The CSR decides to join one of the Usted sessions and clicks on the session 

concerned. This results in an identifier of the session being passed via the SMS to 
5 the CSM together with an identifier of the CSR. 

[3] The CSR is then joined to the indicated session in the normal way. 

By arranging for the session identifier to be passed to the CSR desktop firom the overview 
subsystem, the join request to the CSM can be made by the CSR's system rather than by 
10 the overview sub-system. 



Virtual Representatives & Bets 

A real, human, CSR interacts in a communication session using a desktop GUI application 
1 5 which provides media GUIs for each media type. In the CSR desktop described above with 
reference to Figures 9 to 1 7, the media GUIs and the overall session control and interaction 
logic, are divided into two parts, often called "model/view" or "semantic/presentation", 
according to principles well understood by persons skilled in the art. This split divides a 
GUI application into a part that contains the core logic and data (the ^model'; elements 24 
20 and 90 in Figure 1 3), and a part that presents this to the user (the View'; elements 82 and 
85 to 88 in Figure 1 3). By splitting the application into two parts in this way, and by using 
standard techniques such as object-oriented programming (e.g. Java Beans), it is possible 
for a software automaton to interact with a session (and its associated service instance and 
session transport) in exactly the same way as a human being, with the difference that a 
25 human being interacts via the view components, and the automaton interacts directly via 
the imderlying model components. 

To give dm example, suppose the chat media type component receives a ''new chat text" 
event, and delivers a line of text chat to be displayed. For a human being this text would be 
30 passed to the view component for display in the chat window, while for an automaton the 
text would be passed directly to the automaton (and, in particular, into a natural language 
parser of the automaton). 
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As a result, an automaton can be set up to do anything in a cx)mmunication session that a 
human being can do. Below are described several bots arranged to interact with the web 
interaction service system to carry out useful tasks. Several of these Bots make use of a 
5 "stealth" feature enabling them to join and be present in a session without the other session 
participants being aware of this. More particularly, where the joining of a participant 
would normally be conmiunicated to the other participants, the silent joining of a Bot can 
be achieved by providing a stealth attribute for each participant which the session (or its 
associated service instance) examines before annoimcing the arrival of the new participant 

10 to the other participants; if the attribute is set 'true', no joining announcement is made and, 
optionally, the session transport can be instructed not to transmit on any output from the 
participant in the stealth mode. The stealth attribute can be set *true' by a joining 
participant, though this ability is preferably restricted to privileged entities (generally Bots 
but potentially also human CSR supervisors, etc). At any time the privileged entity may 

1 5 decide to set the stealth attribute to "false", thereby removing the stealth measures (such as 
blocking of outward transmissions) for the participant concemed and, optionally, also 
annoxmcing the presence of the previoxisly-hidden participant as if the latter had only just 
joined the session. 

20 Multi-Channel Personalised Marketing Bot 

This Bot is applicable, for example, to the customer : contact-center scenario where a 
customer is waiting to either initiate or resume conununication with a CSR. 

Consider the situation of the customer having requested contact with a CSR and having 
25 been invited into and joined a new conununication session (i.e step [6] of Figure 8 has 
been completed). The customer is now left waiting for a CSR to be allocated and joined to 
the session (steps [7], [8] and [9] of Figure 8). This may take some time and the customer 
may therefore be given feedback about how long it will take for a CSR to answer their call 
(for example, either via an existing media channel or by returning an HTML page to a 
30 customer browser window when polled by the Customer Desktop). However, more 
efficient use of that wait time can be made by presenting the cxistomer with content of 
potential interest to them. 
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To this end, upon the customer joining the session and a CSR allocation request being sent 
by the session service instance to the contact center management system, the service 
instance invites a special Marketing Bot to join the communication session for either 
5 interactive or non-interactive content presentation to the customer, pending a CSR joining 
the session. The Bot selects content for presentation and sends it to the customer desktop 
using a media channel present in the current session. Upon receipt of this content, the 
customer desktop displays it in the most appropriate manner. The content may be a 
reference (e.g. URL) to the information to be displayed or the data itself. 

10 

The Bot is a software component that has the same basic functions as the CSR desktop and 
uses the same session and transport interfaces as the CSR desktop to interact with the 
session and exchange media content with the customer, the latter being done using the 
same media channels as are to be used subsequently by the allocated CSR desktop. All the 
1 5 media clients in the customer desktop are exposed in this way to the Bot. Thus, anything a 
CSR can do with a customer, the Marketing Bot can also do 

. Figure 26 illustrates the general structure of the Marketing Bot 129 against that of the 
Cxistomer Desktop, the components of the latter being given the same reference nvmierals 

20 as in Figure 18 Customer Desktop (since the Customer Desktop in Figure 25 is of 
substantially the same form as described with reference to Figure 18, the Customer 
Desktop shown in Figure 25 will not be further described). The Marketing Bot 129 joins 
the session using its communication session client 130 and leg controller 20 (the latter 
having been instantiated, as in the CSR Desktop, by leg initiator functionality , not shown, 

25 in response to the join invitation from the session 11). For each media type supported by 
the customer's desktop for the current session, there is a media content handler 132 
responsible for media of that type (the Bot 1 29 knows which media types are being used in 
the session, and therefore what handlers to instantiate, because it has been passed the 
media description when it was invited into the session). Each media handler 132 is 

30 connected to the corresponding media channel of the session transport 1 5 using the session 
transport functionality 1 3 1 of the Bot. In the present example, four representative content 
handlers 132 are shovm, for audio, video, chat and 3D content. Each media handler is 
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responsible for accessing media of the corresponding type from a content repository 133 
(typically, a collection of media files on hard disk.) . 



A script interpreter 134 is provided for running scripts 135 for use, for example, in 
5 effecting content selection and controlling the media handlers 1 32 to present the selected 
content to the customer via the appropriate media channel (amongst those available); 
scripts 1 34 can also be used to manage customer interactions where content presentation is 
done interactively. When the Bot first joins the session, a manager script is run in order to 
effect initial content selection; this selection is done on the basis of the available 

10 information about the customer (see arrow 136 and the further description below). The 
manager script may also control subsequent content updates. However, where the content 
presentation is interactive, control is likely to pass to the element currently called upon to 
present content to the customer (this element may be another script or a helper application 
137 such as a Bot with an associated knowledgebase for anwering specific types of 

15 queries). 

As already indicated, content presentation can be done non-interactively or interactively. If 
non-interactive content presentation is used, then the content is preferably periodically 
updated, not only to enable a range of information to be presented to the ciistomer, but also 

20 to reassure the customer that their machine has not been disconnected from the call centre. 
Alternatively, the content may invite the customer to interact with it, e.g. conversing with 
a bot (effectively a sub-bot used by the Marketing Bot), reviewing a product presentation, 
etc., providing a more involving experience and reducing the likelihood that the customer 
will abandon the call. Customer input can be passed to the Marketing Bot either over a 

25 relevant media channel or via a special control channel, the input being detected by 
appropriate fimctionality associated with the channel concerned. In either case, the 
customer input can be used to control the content delivered over one channel or over all 
chaimels (in this latter case, the input will generally be passed to a controlling script 
running in the script interpreter). 

30 

The media channel that is used and the way in which the content is displayed on the 
customer desktop is completely open. If the content is a URL then it may be displayed in 
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an existing window on the customer desktop, e.g. the page push window, or a new window 
might be opened to display the content (and any subsequent updates). If the content is 
being presented for interactive use, then either the chat channel could be used and the 
existing chat user interface leveraged or a separate window opened for the new content 
5 which may also be distributed on a dedicated channel. Indeed, content may be transmitted 
on multiple channels simultaneously, e.g. a text description of the accompanying a 3D 
product visualisation. 

As regards the selection of content for presentation to the user, this is preferably done of 
10 the basis of the available information about the customer (such as the customer's 
interests). This available information includes the initiation context for the session which 
will already contain some information about the customer and the subject in which the 
customer is currently interested. Additional information may be available from a personal 
profile associated with the customer (held, for example, in database 39 shown in Figures 6 
1 5 and 7), the profile having been constructed from previous interactions with the call centre 
and/or provided by the customer through use of a form. The 'Svake" of the customer 
showing the progress of the customer througji the website pages may also be available 
from a wake repository. Financial data (e.g credit limit, spend pattern) may be obtainable 
from an enterprise customer accoxmting system. 

20 

Once a CSR joins the session, the content presented by the Bot 129 is removed from the 
customer desktop; this can be automatically in response to the session Cormected event 
reporting joining of the CSR, or can be done in response to an erase input from the CSR or 
customer. This explicit erase alternative enables the customer first to question the CSR 

25 about the content presented by the Bot 1 29 should the customer so wish. To facilitate this, 
as the CSR desktop connects to each media channel, it is preferably delivered the last 
content item passed along that channel to the customer. This can be achieved by using a 
transcript Bot that is joined to the session at the same time as the marketing Bot. The 
transcript Bot is similar in form to the Marketing Bot except that the functionality 

30 overlying the media handlers 1 42 is record (and playback) ftmctionality for each channel. 
The transcript serves to record the media content delivered through each channel either for 
offline analysis, or for playback down the chaimels to one or more selected participants. In 
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the present case, upon the service instance receiving notification that the CSR desktop has 
connected to the session transport, it commands the transcript Bot (via any of the 
communication paths available to it) to replay to the CSR desktop the most recent content 
passed down each channel. The transcript Bot does this by sending the content over the 
5 channels to the session transport functionality at the service system together with an 
indication that the content is only to be sent on the CSR desktop; the session transport then 
delivers the content accordingly. This replay feature can usefully be provided in any 
situation where a party is joining a non-empty session. 

1 0 At any point after the call has been allocated to a CSR, that CSR may choose to transfer the 
call to a colleague. If there is a delay before being connected to the new CSR, the pushing 
of personalised content using Bot 129 to the customer can be resumed. 

The use of Bot 129 is not restricted to the presentation of marketing information and other 
1 5 types of information could equally well be presented. Furthermore, the Bot 1 29 can be used 
in scenarios additional to the customer : CSR scenario; for example, in the "Shop with 
Friends" scenario, after the group leader has joined the session and is waiting for the other 
group members to connect ,it may be useful to use a Bot 1 29 to present useful information 
to the leader about how best to explore the site of interest. 

20 

Content Semantics Monitoring Bot 

A content monitoring Bot can be used to help a CSR supervisor in their job of ensuring 
that CSRs handle calls in an eflScient and customer-fHendly manner. 

25 In a first role, the content monitoring Bot seeks to match content being exchanged across 
the session transport of a session, with one or more prescribed filter criteria (generally 
words and phrases but any media-content attribute value can be used as a criterion), and to 
alert interested parties when a match is fovmd. Example uses of such filters are: 
• Detecting the presence of profanity or abusive terms and phrases. 
30 • Detecting the transmission/sharing of undesirable material or references to such 
material. 
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In a second role, the content-monitoring Bot can be used to collect and analyse statistics 
on a call based on the content sent between custonier(s) and CSR which could be used to 
identify (among others): 
• Call duration. 

5 • CSR performance in terms, for example, of speed of response to customer's inputs. 

i.e. some measure of time between receiving content on a channel and responding 
to it. 

A long call duration with a low response rate might indicate an overloaded CSR 
(potentially too many simultaneous calls), and a long call duration with a high response 
10 rate might indicate an overly "chatty** CSR. 

The structure of the Content-Monitoring Bot is shown in Figure 27. The structure is similar 
to that of the Marketing Bot 129 (Figure 26) described above except that now the 
functionality overlying the media handlers 1 32 is concerned with monitoring the content 
1 5 received through these handlers over the media channels associated with a session being 
monitored. This functionality comprises a filter manager 140 and alert manager 141 for 
carrying out the first role mentioned above, and a statistics manager 142 for carrying out 
the second role. 

20 The content-monitoring Bot 139 is arranged to join a selected session silently, that is, 
without being announced or without otherwise being detectable by the other session 
participants. This is done by using the above-described stealth attribute which the Bot 1 39 
sets "true'* upon joining the session. 

25 As regards the selection of the session to be monitored by the Bot 139, this can be done 
explicitly by a supervisor (for example, by viewing a session list as described above in 
relation to Figure 25, and designating a session for the Bot to join). Alternatively, sessions 
can be randomly or systematically selected for monitoring (for example, all sessions 
involving a particular CSR could be monitored, this being achievable by setting an 

30 appropriate alert trigger using the arrangement of Figure 24, with the alert messages being 
used to automatically join the Bot to the session concerned). Of course, multiple sessions 
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can be monitored at the same time, for example by instantiating a respective Bot for each 
session to be monitored. 

The filter manager 140 interfaces with the media handlers 1 32 to evaluate the filters it has 
5 been provided with against incoming content. In its simplest form, the filter manager 140 is 
restricted to monitoring a chat channel for specific words and phrases. However, the same 
architecture can be applied to monitoring arbitrary media channels with the use of 
conversion fimctionality to turn the received content into a form that can be easily 
compared with filter criteria; for example, for the filter manager to monitor an audio chat 
10 channel, it is provided with a speech-to-text converter, the filter criteria generally taking 
theform of words and phrases specified in text format. 

Where a page-push channel is provided, the content filters applied to that channel will 
generally take the form of URLs or domain names (corresponding, for example, to sites 
1 5 offering obscene content). 

When a match is found between the content being monitored and a filter, the alert manager 
141 is informed and an appropriate action is taken depending upon which filter matched 
and what the media channel was. Typically that action is to send a message to the 
20 supervisor's desktop indicating what the problem is, the session details, the content causing 
the alert, and whether the CSR or the customer was responsible for that content. The 
supervisor can then decide whether any fiirther action should be taken, e.g. joining the 
session, terminating it, etc. 

25 The Bot may also provide the supervisor with a transcript of the content exchange across 
the channel concerned leading up to the alert, and communicate with a transcript Bot to 
ensure that this transcript is saved for fiirther examination; the transcript Bot (described 
above) is joined to the session at the same time as the content monitoring Bot. 

30 The analysis of the exchanged content can be used to improve CSR scripts, contributing to 
a knowledge base or even providing material for a Bot that acts as a virtual CSR. There are 
also fiirther applications to which the content monitoring Bot can be put, such as using the 
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chat transcripts for refining the Frequently Asked Questions knowledgebase found on most 
web sites, acting as a "did you know?" helper that suggests other material that might be 
relevant when it detects keywords, etc. 

5 The statistics manager 1 42 uses the media handler interfaces to extract pertinent statistical 
information that is logged to a database 143 for later evaluation. 

Although the content-monitoring Bot has been described above in the context of a contact 
center, it will be appreciated that the Bot can also be used in other situations not restricted 
10 to customer service centres. 

Automatic Helper Bot 

This Bot provides help to participants in a page-specific commxmi cation session, the Bot 
15 joming the session upon the exchanged content indicating that assistance may be needed. 
The helper Bot is basically an extension of the content-monitoring Bot and like the latter 
uses stealth mode to silently join and monitor content in a selected session (selected in any 
suitable maimer as described above for the content monitoring Bot). The helper Bot 
monitors for triggers that are specified, for example, in the form of specific content (such 
20 as particular keywords like "help" or the equivalent in other media types), content 
combinations, or content patterns. A trigger condition can involve content combinations or 
patterns involving content from multiple channels. 

Upon a trigger being matched, the helper Bot automatically sets its stealth mode attribute 
25 to 'false' thereby making its presence in the session known to the other session participants 
(so far as they are concemed, it appears as if the Bot has timely joined the session). The 
helper Bot then seeks to provide page-specific assistance on the basis of its knowledge of 
the page contents and potentially also of the participants concemed (information about the 
participants being available in the session and possibly also from a customer profile 
30 database). The helper Bot will generally not be tied to a specific page but will provide 
page-specific assistance on the basis of a knowledge of the page associated with the session 
and information about that page contained in a knowledgebase accessible to the helper Bot. 
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Where the helper Bot uses the session/customer real-time database 1 27 to select a session 
to join, the identity of the page session and its current participants is readily available to the 
helper Bot, 

5 Moreover, customer context information can be automatically extracted as described 
earlier. 

The helper Bot can also be joined to sessions that are not tied to particular pages; in this 
case, the helper Bot can be arranged to adapt the assistance it gives to a currently viewed 
1 0 page (where the page identity is available) or simply to the content most recently received 
over the media channels. 

Variants 

It will be appreciated that many variants are possible to the above-described web 
15 interaction system. For example, the connection state of an endpoint system could be 
communicated to a session instance by the corresponding transport instance rather than 
through leg controllers. As regards session identifiers, these can take many forms and, 
indeed, can be anything that can directly or indirectly identify a created or to be created 
session. 

20 

Whilst Figures 20-22, 24 illustrate particular services in the case of end user systems 
provided with applet desktops, it will be appreciated that the same services could equally 
be provided with the Lite desktop (or, indeed, any other suitable user interface). 

25 The service system can be a third party system accessed by users, including contact center 
CSRs, over the internet. 
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CLAIMS 



1. A helper entity for selectively offering assistance to an endpoint entity connected to at 
least one media channel established in respect of a network communication session to 

5 which the endpoint entity is joined, the helper entity comprising: 

an entity manager for receiving, in respect of the communication session, channel 
information about the channels established for the session; 

a transport subsystem for establishing, in accordance with the channel information 
received by the entity manager, at least one media channel connection to a session 
1 0 transport mechanism associated with said session; 

a media subsystem providing a respective media handler of appropriate type for the 
each media channel connection established by the transport subsystem, each media 
handler serving to receive and transmit content over the corresponding media 
channel; 

15 - a monitor subsystem connected to the media handlers for matching content received 
by the media handlers with predetermined triggers; and 

an advisor subsystem responsive to responsive to the monitor subsystem finding a 
match to transmit advisory content on at least one channel via the corresponding 
media handler. 

20 

2. A helper entity according to claim 1 , wherein predetermined triggers are specified in the 
form of at least one of specific content, content combinations, and content patterns. 

3. A helper entity according to claim 1 , wherein at least one said predetermined trigger is 
25 specified in the form of content combinations or content patterns involving content on 

multiple channels. 

4. A helper entity according to claim 1 , wherein the monitor subsystem manager includes, 
for at least one channel, a converter for converting the content received over the 

30 corresponding channel into a different form, this form being a form in which the monitor 
subsystem is adapted to carry out its matching of content with triggers. 



72 

5. A helper entity according to claim 1, wherein the advisor subsystem is operative to 
adapt the advisory content it delivers to be appropriate to content recently received over the 
connected channels. 

6. A helper entity according to claim 1, wherein the advisor subsystem is operative to 
receive context data regarding the communication session and to adapt the advisory content 
it delivers accordingly. 

7. A helper entity according to claim 6, wherein the context data includes data about 
endpoint entities connected to the session. 

8. A helper entity according to claim 6, wherein the context data includes identity data 
about the endpoint entities joined to the session, the advisory subsystem including database 
access functionality for using the identity data to look up information about the entities in a 
database, this information then being used by the advisor system to adapt the advisory 
content it delivers. 

9. In combination, a helper entity according to any one of the preceding claims, an 
information page server for serving information pages, and a service system for 
establishing a respective communication session for each of at least some of the 
information pages and for joining to such session endpoint entities browsing the 
corresponding page, each communication session that is established having an associated 
transport mechanism allowing the exchange of data, via data transfer channels, between 
endpoint systems joined to the session; the service system being operative to join the helper 
entity to a said session to offer assistance when appropriate to endpoint systems joined to 
the session. 

10. The combination set out in claim 9, wherein the advisory content provided by the 
advisor subsystem is specific to the page associated with the session to which the helper 
entity is joined. 
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11. The combination of claim 9, wherein the service-session functional entity joins the 
helper entity to the session in a manner such that other entities joined to the session are 
unaware of the joining of the helper entity. 

5 12. The combination set out in claim 9, wherein the service system includes a real-time 
database for recording for each session that is established, the identity of the associated 
information page and of any endpoint entity currently joined to the session, and a customer 
database, the helper entity including database access functionality for accessing the real- 
time database to aiscertain the identities of the entities joined to the session which it then 
10 uses to adapt the advisory content it delivers. 

13. In combination, a helper entity according to any one of claims 1 to 8, and a service 
system for setting up a communication session with an associated transport mechanism 

15 allowing the exchange of data, via data transfer channels for different media types, 
between endpoint entities joined to the session; the service system, in setting up a 
communication session, creating a service-session functional entity for controlling the 
joining of endpoint entities to the session in accordance with a predetermined service 
behaviour, and the service-session functional entity being resf>onsible for joining the helper 

20 entity to the session as required, this joining involving the sending of said channel 
information to the helper entity. 

14. The combination of claim 13, wherein the service-session functional entity joins the 
helper entity to the session in a manner such that other entities joined to the session are 

25 imaware of the joining of the helper entity. 

15. The combination of claim 13, wherein the service-session functional entity comprises 
a session instance with generic behaviour for adding and removing endpoint entities to the 
communication session and for recording the endpoint entities currently joined to the 

30 commimication session, and an associated service instance with service-specific behaviour 
determining when the session instance is to add and remove endpoint entities. 
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16. The combination of claim 13, wherein the state of connection of the helper entity to 
the transport mechanism is signalled to the session-service functional entity by leg 
messages passed between a leg controller of the entity manager of the helper entity and a 
corresponding leg controller of the service-session functional entity. 
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ABSTRACT 

Helper Entity for Communication Session. 

A helper entity monitors content on media channels established in respect of a network 
communication session. Upon a content-dependent trigger condition being met, the helper 
entity delivers advisory content over one or more of the chaimels. 
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